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(57) Volume of communication necessary for dis- 
playing moving images is minimized- When an object is 
moved on a client terminal (13-1), a message indicating 
the movement of the object is transmitted to a server 
terminal (1 1 -1 ). The server terminal (11-1) transmits the 
message to client terminals (13-2 and 13-3). Each of 
the client terminals (13-1) through (13-3) stores a mes- 
sage table in advance to execute the message. Accord- 
ing the message table, an image for locally moving an 



object (101) is generated and displayed. This novel 
setup transmits information about, the update of an 
update objects composed of a plurality of sub objects 
each of which state is subject to change, in a minimum 
transmission volume. This, in turn, allows cooperative 
operations of the plurality of sub objects to be smoothly 
displayed in a three-dimensional virtual reality space 
shared by a plurality of users. 
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Descripti n 

BACKGROUND OF THE INVENTION 

5 The present invention relates to a method of sharing a three-dimensional virtual reality space, a system of sharing 

a three-dimensional virtual reality space, a method of information processing, an information recording medium, a 
method of information recording, an information transmission medium, a method of information transmission, a client 
terminal, and a shared server terminal and, more particularly, to a method of sharing a three-dimensional virtual reality 
space, a system of sharing a three-dimensional virtual reality space, a method of information processing, an informa- 

70 tion recording medium, a method of information recording, an information transmission medium, a method of informa- 
tion transmission, a client terminal, and a shared server terminal which are suitable for generating a virtual reality space 
for example to be provided to users. 

A cyberspace service named Habitat (trademark) is known in the so-called personal computer communications 
services such as NIFTY-Serve (trademark) of Japan and CompuServe (trademark) of US in which a plurality of users 

75 connect their personal computers via modems and public telephone network to the host computers installed at the cent- 
ers of the services to access them in predetermined protocols. Development of Habitat started in 1985 by Lucas Film 
of the US, operated by Quantum Link, one of US commercial networks, for about three years. Then, Habitat started its 
service in NIFTY-Serve as Fujitsu Habitat (trademark) in February 1990 . In Habitat, users can send their alter egos 
called avatars (the incarnation of a god figuring in the Hindu mythology) into a virtual city called Populopolis drawn by 

20 two-dimensional graphics to have a chat (namely, a realtime conversation based on text entered and displayed) with 
each other. For further details of Habitat, refer to the Japanese translation of "Cyberspace: First Steps," Michael Ben- 
edikt, ed., 1991, MIT Press Cambridge, MA, ISBN0-262-02327-X, the translation being published March 20, 1994, by 
NTT Publishing, ISBN4-87188-265-9C0010, pp. 282-307. 

In the related art cyberspace system operated on such personal communications servers as mentioned above, a 

25 virtual street, a virtual room interior, and the like are drawn in two-dimensional graphics. In such an environment, move- 
ment of an avatar backward or forward is realized simply by moving it up or down in a two-dimensional background, pro- 
viding poor representation for enabling the user to experience walk or movement in the virtual space. Because this 
scheme makes the user look at the virtual space in which the user's avatar and another user's avatar are shown from 
the viewpoint of a third person, the sense of pseudo experience is marred to a large extent. Therefore, realization of the 

30 walk-through capability has been awaited by the industry concerned, in which the virtual space is displayed in three- 
dimensional graphics and an avatar can walk freely in the virtual space from the viewpoint of avatar itself, thus enhanc- 
ing the sense of pseudo experience. 

On the other hand, for a related art example for realizing the sharing of a three-dimensional virtual reality space on 
a network, a system of FIG. 42 is known which is constituted by client terminals 3-1 through 3-3 interconnected by the 

35 LAN (Local Area Network) installed in companies or laboratories. 

First, ail client terminals 3-1 through 3-3 read graphics data from a storage device 2 of a server terminaM that 
describe the same three-dimensional space to display the same three-dimensional space. At this point of time, the 
three-dimensional spaces visually recognized by all users match each other. Namely, the client terminals 3-1 through 
3-3 show three-dimensional images according to the viewpoints of the users of these terminals as shown in FIGS. 43 

40 A through 43 C. In this example, a triangular pyramidal object 101, a quadrangular prism object 102, and a cylindrical 
object 103. 

Meanwhile, if. at a client terminal 3-1, the user changed positions of the conical object 101, information about the 
change (change information) is sent from the client terminal 3-1 to the server 1 via a LAN 4. The change information 
about the movement is then transmitted from the server terminal 1 via the LAN 4 to the client terminals 3-2 and 3-3. 

45 Then, on the client terminals 3-2 and 3-3, the display position of the conical object is changed according to the change 
information transmitted from the client terminal 3-1 . 

Likewise, when, on the client terminal 3-2 or 3-3, an operation is made to move the quadrangular prism object 102 
or the cylindrical object 103, an image in which the quadrangular prism object 102 or the cylindrical object 103 has been 
moved accordingly is displayed on the client terminal 3-1 . 

so To be more specific, when a change is made to the virtual reality space on any of the client terminals 3-1 through 

3-3, the change is reflected in the display of the other client terminals, thereby allowing the users of the client terminals 
3-1 through 3-3 to share the same virtual reality space. 

The above-mentioned objects 101 through 103 and avatar objects representing the users can be moved within a 
virtual reality space and made enter or exit the virtual reality space, the states of the objects being changed (or updated) 

55 . inside the virtual reality space. The objects that can change their states are hereinafter appropriately referred to as 
update objects. Unlike the update objects, objects representing buildings for example which constitute a town in a vir- 
tual reality space are commonly used by a plurality of users, the basic states of such objects remaining unchanged. 
Even if their states change, such a change is autonomous; namely, the change takes place independently of the oper- 
ation made on a client terminal. These objects which are used by a plurality of users are hereinafter appropriately 
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referred to as basic objects. 

Meanwhile, in the system for sharing a three-dimensional virtual reality space by using the LAN as shown in FIG. 
42, if objects 101 through 103 each having a simple shape consisting of a single object as shown in FIG. 43, it can be 
implemented by transferring the identification numbers of the objects 101 through 103 and the update information 

5 including shift vectors of the objects 101 through 103 for example. 

However, moving an object having a complex shape consisting of a plurality of sub objects has to transfer the iden- 
tification number and update information of each sub object separately, thereby increasing the traffic through the LAN 
and delaying the transmission of each update information, resulting in a mismatch between the movements of the 
objects displayed on the client terminals 3-1 through 3-3, a delay in a plurality of sub objects, and eventually in a jerky 

70 movement in a series of interlocking operations as an object in its entirety. 

For example, FIG. 44 shows principles of operation of representing the walking behavior of an avatar simulating a 
user in a three-dimensional virtual reality space. In this example, the avatar object is constituted by a total of five sub 
objects; a body including a head, a right arm, a left arm, a right leg, and a left leg. To make the hands and the legs of 
this avatar swing to provide a walk behavior along with the movement of this avatar, it is required to transmit the update 

75 information at least including the shift vector of the body sub object, the shift vectors of the right-arm, left -arm, right-leg 
and left-leg sub objects, the fluctuation angle from the axis provided by the joint to the body, along with the identification 
numbers of the sub objects. 

Consequently, the number of sub objects constituting each object increases. Therefore, as a movement involving 
more complex operations is expressed, the volume of communication for transmitting the update information of objects 
20 increases, thereby increasing the load to the server terminal 1 and decreasing the smoothness of the display of the 
movement of the object represented by the cooperative operations of the sub objects. 

SUMMARY OF THE INVENTION 

25 . It is therefore an object of the present invention to provide a method of sharing a threeKJimensional virtual reality 
space, a three-dimensional virtual reality space sharing system, a method of information processing, an information 
recording medium, a method of information recording, an information transmission medium, a method of information 
transmission, a client terminal, and a server terminal for transmitting, in a minimum quantity, the update information of 
an update object composed of sub objects of which states are subject to change and smoothly displaying a cooperative 

30 operation of these sub objects in a three-dimensional virtual reality space shared by a plurality of users. 

In carrying out the invention and according to a first aspect thereof, a method of sharing a three-dimensional virtual 
reality space comprising the steps of: connecting a plurality of client terminals for displaying a three-dimensional virtual 
reality space including an update object constituted by a plurality of sub objects each of which state is subject to change 
to a shared server terminal for controlling a state of the update object on each of the plurality of client terminals via a 

35 communication network; registering in each of the plurality of client terminals in advance a change sequence table for 
defining a relationship between a sequence of changing the state of each of the plurality of sub objects according to a 
change to the state of the update object and a message for specifying a type of the change sequence; when the state 
of the update object controlled by the shared server terminal is updated, notifying each of the plurality of client terminals 
of the message corresponding to updated content of the state of the update object from the shared server terminal; and 

40 changing on each of the plurality of client terminals the state of each of the plurality of sub objects based on the change 
sequence specified by the message to reflect the change in the displayed three-dimensional virtual reality space. 

In carrying out the invention and according to a second aspect thereof, there is provided a system of sharing a 
three-dimensional virtual reality space comprising: a plurality of client terminals for displaying a three-dimensional vir- 
tual reality space including an update object constituted by a plurality of sub objects each of which state is subject to 

45 change; a shared server terminal for controlling a state of the update object on each of the plurality of client terminals; 
a communication network for connecting each of the plurality of client terminals to the shared server terminal; and a 
change sequence table for defining a relationship between a change sequence of the state of each of the sub objects 
corresponding to update content of the state of the update object and a message for specifying a type of the change 
sequence, the change sequence table being registered in each of the plurality of client terminals in advance; wherein, 

so when the state of the update object controlled by the shared server terminal is updated, the shared server terminal noti- 
fies each of the plurality of client terminals of the message corresponding to updated content of the state of the update 
object, and each of the client terminals changes the state of each of the plurality of sub objects based on the change 
sequence specified by the message to reflect the change in the displayed three-dimensional virtual reality space. 

In carrying out the invention and according to a third aspect thereof, there is provided an information recording 

55 medium for use in a three-dimensional virtual reality space sharing system to record a computer program comprising 
the processing steps of: connecting a plurality of client terminals for displaying a three-dimensional virtual reality space 
including an update object constituted by a plurality of sub objects each of which state is subject to change to a shared 
server terminal for controlling a state of the update object on each of the plurality of client terminals via a communication 
network; registering in each of the plurality of client terminals in advance a change sequence table for defining a rela- 
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tionship between a sequence of changing the state of each of the plurality of sub objects according to a change to the 
state of the update object and a message for specifying a type of the change sequence; when the state of the update 
object controlled by the shared server terminal is updated, notifying each of the plurality of client terminals of the mes- 
sage corresponding to updated content of the state of the update object from the shared server terminal; and changing 

s on each of the plurality of client terminals the state of each of the plurality of sub objects based on the change sequence 
specified by the message to reflect the change in the displayed three-dimensional virtual reality space; wherein the 
computer program is readable and executable by at least one of the terminals consisting of the shared server terminal 
and the plurality of client terminals. 

In carrying out the invention and according to a fourth aspect thereof, there is provided an information recording 

w method for use in a three-dimensional virtual reality sharing system to record a computer program in an information 
recording medium, the computer program comprising the processing steps of: connecting a plurality of client terminals 
for displaying a three-dimensional virtual reality space including an update object constituted by a plurality of sub 
objects each of which state is subject to change to a shared server terminal for controlling a state of the update object 
on each of the plurality of client terminals via a communication network; registering in each of the plurality of client terr 

/s minals in advance a change sequence table for defining a relationship between a sequence of changing the state of 
each of the plurality of sub objects according to a change to the state of the update object and a message for specifying 
a type of the change sequence; when the state of the update object controlled by the shared server terminal is updated, 
notifying each of the plurality of client terminals of the message corresponding to updated content of the state of the 
. update object from the shared server terminal; and changing on each of the plurality of client terminals the state of each 

20 of the plurality of sub objects based on the change sequence specified by the message to reflect the change in the dis- 
played three-dimensional virtual reality space; wherein the computer program is readable and executable by at least 
one of the terminals consisting of the shared server terminal and the plurality of client terminals. 

In carrying out the invention and according to a fifth aspect thereof, there is provided an information transmission 
medium for use in a three-dimensional virtual reality space sharing system to transmit a computer program comprising 

25 the processing steps of: connecting a plurality of client terminals for displaying a three-dimensional virtual reality space 
including an update object constituted by a plurality of sub objects each of which state is subject to change to a shared 
server terminal for controlling a state of the update object on each of the plurality of client terminals via a communication 
network; registering in each of the plurality of client terminals in advance a change sequence table for defining a rela- 
tionship between a sequence of changing the state of each of the plurality of sub objects according to a change to the 

30 state of the update object and a message for specifying a type of the change sequence; when the state of the update 
object controlled by the shared server terminal is updated, notifying each of the plurality of client terminals of the mes- 
sage corresponding to updated content of the state of the update object from the shared server terminal; and changing 
on each of the plurality of client terminals the state of each of the plurality of sub objects based on the change sequence 
specified by the message to reflect the change in the displayed three-dimensional virtual reality space; wherein the 

35 computer program is readable and executable by at least one of the terminals consisting of the shared server terminal 
and the plurality of client terminals and the executable computer program is transmitted to at least one of the terminals 
consisting of the shared server terminal and the plurality of client terminals. 

In carrying out the invention and according to a sixth aspect thereof, there is provided an information transmission 
method for use in a three-dimensional virtual reality space sharing system to transmit a computer program comprising 

40 the processing steps of: connecting a plurality of client terminals for displaying a three-dimensional virtual reality space 
including an update object constituted by a plurality of sub objects each of which state is subject to change to a shared 
server terminal for controlling a state of the update object on each of the plurality of client terminals via a communication 
network; registering in each of the plurality of client terminals in advance a change sequence table for defining a rela- 
tionship between a sequence of changing the state of each of the plurality of sub objects according to a change to the 

45 state of the update object and a message for specifying a type of the change sequence; when the state of the update 
object controlled by the shared server terminal is updated, notifying each of the plurality of client terminals of the mes- 
sage corresponding to updated content of the state of the update object from the shared server terminal; and changing 
on each of the plurality of client terminals the state of each of the plurality of sub objects based on the change sequence 
specified by the message to reflect the change in the displayed three-dimensional virtual reality space; wherein the 

so computer program is readable and executable by at least one of the terminals consisting of the shared server terminal 
and the plurality of client terminals and the executable computer program is transmitted to at least one of the terminals 
consisting of the shared server terminal and the plurality of client terminals. 

In carrying out the invention and according to a seventh aspect thereof, there is provided an information processing 
method of a client terminal in a three-dimensional virtual reality space sharing system in which a plurality of client ter- 

55 minals for displaying a three-dimensional virtual reality space including an update object constituted by a plurality of sub 
objects each of which state is subject to change are connected to a shared server terminal for controlling a state of the 
update object on each of the plurality of client terminals via a communication network, the information processing 
method comprising the steps of: registering in each of the plurality of client terminals in advance a change sequence 
table for defining a relationship between a sequence of changing the state of each of the plurality of sub objects accord- 
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ing to a change to the state of the update object and a message tor specifying a type of the change sequence; acquiring 
the message corresponding to the update content of the state of the update object, the message being notified from the 
shared server terminal when the state of the update object controlled by the shared server terminal is updated; and 
changing the state of each of the plurality of sub objects based on the change sequence specified by the message to 

5 reflect the change in the displayed three-dimensional virtual reality space. 

In carrying out the invention and according to an eighth aspect thereof, there is provided a client terminal in a three- 
dimensional virtual reality space sharing system in which a plurality of client terminals for displaying a three-dimen- 
sional virtual reality space including ^n update object constituted by a plurality of sub objects each of which state is sub- 
ject to change are connected to a shared server terminal for controlling a state of the update object on each of the 

w plurality of client terminals via a communication network, the client terminal comprising: a registering means for regis- 
tering in each of the plurality of client terminals in advance a change sequence table for defining a relationship between 
a sequence of changing the state of each of the plurality of sub objects according to a change to the state of the update 
object and a message for specifying a type of the change sequence; an acquiring means for acquiring the message cor- 
responding to the update content of the state of the update object, the message being notified from the shared server 

is terminal when the state of the update object controlled by the shared server terminal is updated; and a changing means 
for changing the state of each of the plurality of sub objects based on the change sequence specified by the message 
to reflect the change in the displayed three-dimensional virtual reality space. 

In carrying out the invention and according to a ninth aspect thereof, there is provided an information recording 
medium for use in a client terminal in a three-dimensional virtual reality space sharing system to record a computer pro- 
(: 20 gram comprising the processing steps of: registering in each of the plurality of client terminals in advance a change 
sequence table for defining a relationship between a sequence of changing the state of each of the plurality of sub 
objects according to a change to the state of the update object and a message for specifying a type of the change 
sequence; acquiring the message corresponding to the update content of the state of the update object, the message 
being notified from the shared server terminal when the state of the update object controlled by the shared server ter- 

25 minal is updated; and changing the state of each of the plurality of sub objects based on the change sequence specified 
by the message to reflect the change in the displayed three-dimensional virtual reality space; wherein the computer pro- 
gram is recorded in the information recording medium in a state readable and executable by the client terminal. 

In carrying out the invention and according to a tenth aspect thereof, there is provided an information recording 
method of a recording medium for use on a client terminal in a three-dimensional virtual reality space sharing system 

30 to record a computer program comprising the processing steps of: registering in each of the plurality of client terminals 
in advance a change sequence table for defining a relationship between a sequence of changing the state of each of 
the plurality of sub objects according to a change to the state of the update object and a message for specifying a type 
of the change sequence; acquiring the message corresponding to the update content of the state of the update object, 
the message being notified from the shared server terminal when the state of the update object controlled by the shared 

35 server terminal is updated; and changing the state of each of the plurality of sub objects based on the change sequence 
specified by the message to reflect the change in the displayed three-dimensional virtual reality space; wherein the 
computer program is recorded in the recording medium in a state readable and executable by the client terminal. 

In carrying out the invention and according to an eleventh aspect thereof, there is provided an information transmis- 
sion medium for use on a client terminal in a three-dimensional virtual reality space sharing system in which a plurality 
\ 40 of client terminals for displaying a three-dimensional virtual reality space including an update object constituted by a 
plurality of sub objects each of which state is subject to change are connected to a shared server terminal for controlling 
a state of the update object on each of the plurality of client terminals via a communication network, the information 
transmission method transmitting a computer program comprising the processing steps of: registering in each of the 
plurality of client terminals in advance a change sequence table for defining a relationship between a sequence of 

45 changing the state of each of the plurality of sub objects according to a change to the state of the update object and a 
message for specifying a type of the change sequence; acquiring the message corresponding to the update content of 
the state of the update object, the message being notified from the shared server .terminal when the state of the update 
object controlled by the shared server terminal is updated; and changing the state of each of the plurality of sub objects 
based on the change sequence specified by the message to reflect the change in the displayed three-dimensional vir- 

so tual reality space; wherein the computer program is transmitted to the client terminal in a state receivable and executa- 
ble by the same. 

In carrying out the invention and according to a twelfth aspect thereof, there is provided an information transmission 
method for use on a client terminal in a three-dimensional virtual reality space sharing system in which a plurality of cli- 
ent terminals for displaying a three-dimensional virtual reality space including an update object constituted by a plurality 
55 of sub objects each of which state is subject to change are connected to a shared server terminal for controlling a state 
of the update object on each of the plurality of client terminals via a communication network, the information transmis- 
sion method transmitting a computer program comprising the processing steps of: registering in each of the plurality of 
client terminals in advance a change sequence table for defining a relationship between a sequence of changing the 
state of each of the plurality of sub objects according to a change to the state of the update object and a message for 
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specifying a type of the change sequence; acquiring the message corresponding to the update content of the state of 
the update object, the message being notified from the shared server terminal when the state of the update object con- 
trolled by the shared server terminal is updated; and changing the state of each of the plurality of sub objects based on 
the change sequence specified by the message to reflect the change in the displayed three-dimensional virtual reality 
5 space; wherein the computer program is transmitted to the client terminal in a state receivable and executable by the 
same. ' 

In carrying out the invention and according to a thirteenth aspect thereof, there is provided an information process- 
ing method of a shared server terminal in a three-dimensional virtual reality space sharing system in which a plurality 
of client terminals for displaying a threenjimensional virtual reality space including an update object constituted by a 

10 plurality of sub objects each of which state is subject to change are connected to a shared server terminal for controlling 
a state of the update object on each of the plurality of client terminals via a communication network, the information 
processing method comprising the steps of: determining update of the state of the update object controlled by the 
shared server terminal; and when the state of the update object is updated, notifying each of the plurality of client ter- 
minals of a message for specifying a type of a change sequence of each of the plurality of sub objects corresponding 

is to updated content of the state of the update object from the shared server terminal. 

In carrying out the invention and according to a fourteenth aspect thereof, there is provided a shared server termi- 
nal in a three-dimensional virtual reality space sharing system in which a plurality of client terminals for displaying a 
three-dimensional virtual reality space including an update object constituted by a plurality of sub objects each of which 
state is subject to change are connected to a shared server terminal for controlling a state of the update object on each 

20 of the plurality of client terminals via a communication network, the shared server terminal comprising: a determining 
means for determining update of the state of the update object controlled by the shared server terminal; and when the 
state of the update object is updated, a notifying means for notifying each of the plurality of client terminals of a mes- 
sage for specifying a type of a change sequence of each of the plurality of sub objects corresponding to updated con- 
tent of the state of the update object from the shared server terminal. 

25 In carrying out the invention and according to a fifteen aspect thereof, there is provided an information recording 

medium for use on a shared server terminal in a three-dimensional virtual reality space sharing system in which a plu- 
rality of client terminals for displaying a three-dimensional virtual reality space including an update object constituted by 
a plurality of sub objects each of which state is subject to change are connected to a shared server terminal for control- 
ling a state of the update object on each of the plurality of client terminals via a communication network, the information 

30 recording medium recording a computer program comprising the processing steps of: determining update of the state 
of the update object controlled by the shared server terminal; and when the state of the update object is updated, noti- 
fying each of the plurality of client terminals of a message for specifying a type of a change sequence of each of the 
plurality of sub objects corresponding to updated content of the state of the update object from the shared server ter- 
minal; wherein the computer program is stored in the information recording medium in a state readable and executable 

35 by the shared server terminal. 

In carrying out the invention and according to a sixteenth aspect thereof, there is provided an information recording 
method for use on a shared server terminal in a three-dimensional virtual reality space sharing system in which a plu- 
rality of client terminals for displaying a three-dimensional virtual reality space including an update object constituted by 
a plurality of sub objects each of which state is subject to change are connected to a shared server terminal for control- 

40 ling a state of the update object on each of the plurality of client terminals via a communication network, the information 
recording method recording a computer program comprising of the processing steps of: determining update of the state 
of the update object controlled by the shared server terminal; and when the state of the update object is updated, noti- 
fying each of the plurality of client terminals of a message for specifying a type of a change sequence of each of the 
plurality of sub objects corresponding to updated content of the state of the update object from the shared server ter- 

45 minal; wherein the computer program is stored in an information recording medium in a state readable and executable 
by the shared server terminal. 

In carrying out the invention and according to a seventeenth aspect thereof, there is provided an information trans- 
mission medium for use on a shared server terminal in a three-dimensional virtual reality space sharing system in which 
a plurality of client terminals for displaying a three-dimensional virtual reality space including an update object consti- 

so tuted by a plurality of sub objects each of which state is subject to change are connected to a shared server terminal 
for controlling a state of the update object on each of the plurality of client terminals via a communication network, the 
information transmission medium transmitting a computer program comprising the processing steps of: determining 
update of the state of the update object controlled by the shared server terminal; and when the state of the update 
object is updated, notifying each of the plurality of client terminals of a message for specifying a type of a change 

55 sequence of each of the plurality of sub objects corresponding to updated content of the state of the update object from 
the shared server terminal ; wherein the computer program is transmitted to the shared server terminal in a state receiv- 
able and executable by the same. 

n carrying out the invention and according to an eighteenth aspect thereof, there is provided an information trans- 
mission method for use on a shared server terminal in a three-dimensional virtual reality space sharing system in which 
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a plurality of client terminals for displaying a three-dimensional virtual reality space including an update object consti- 
tuted by a plurality of sub objects each of which state is subject to change are connected to a shared server terminal 
for controlling a state of the update object on each of the plurality of client terminals via a communication network, the 
information transmission method transmitting a computer program comprising the processing steps of: determining 

5 update of the state of the update object controlled by the shared server terminal; and when the state of the update 
object is updated, notifying each of the plurality of client terminals of a message for specifying a type of a change 
sequence of each of the plurality of sub objects corresponding to updated content of the state of the update object from 
the shared server terminal ; wherein tfie computer program is transmitted to the shared server terminal in a state receiv- 
able and executable by the same. / 

70 According to the present invention; in the three-dimensional virtual reality sharing method, the system/the informa- 
tion recording medium, the information recording method, the information transmission medium, and the information 
transmission method, the change sequence of the plurality of sub objects corresponding to the updated content of the 
state of the update object is stored in each client terminal and the changes sequences on the plurality of client terminals 
are started in synchronization. \ " . 

is Further, according to the present invention, in the information processing method, the client terminal, the informa- 

tion recording medium, the information recording method, the information transmission medium, and the information 
transmission method, the change sequence of the plurality of sub objects corresponding to the update content of the 
state of the update object is stored in a client terminal and started in synchronization with the change sequences stored 
in other client terminals. 

20 Further, according to the present invention, in the information processing method, the server terminal, the informa- 

tion recording medium, the information recording method, the information transmission medium, and the information 
transmission method, if a message indicating update of the state of the update object is entered from a specific client 
terminal via the global communication network, this message is transmitted to other client terminals via the global com- 
munication network and, in synchronization with the change sequence of the plurality of sub objects in the specific client 

25 terminal, the change sequences of the plurality of sub objects in the other client terminals are started. 

The above and other objects, features and advantages of the present invention will become more apparent from 
the accompanying drawings, in which like reference numerals are used to identify the same or similar parts in several 
views. 

30 BRIEF DESCRIPTION OF THE DRAWINGS . 

FIG. 1 is a block diagram illustrating an example of the constitution of a cyberspace system practiced as one pre- 
ferred embodiment of the present invention; 

FIG. 2 is a block diagram illustrating an example of the constitution of a server terminal 1 1 of FIG. 1 ; 
35 FIG. 3 is a block diagram illustrating an example of the constitution of a client terminal 13 of FIG. 1 ; 

FIG. 4 is a block diagram illustrating an example of the constitution of a service provider terminal 14 of FIG. 1 ; 

FIG. 5 is a diagram describing a virtual reality space formed by the cyberspace system of Fig 1 ; 

FiG. 6 is a diagram describing a view field seen from avatar C; 

FIG. 7 is a diagram describing a view field seen from avatar D; 
40 FIG. 8 is a diagram describing message transmission in the cyberspace system; 

FIG. 9 A is a diagram describing a display example of a message list; 

FIG. 9 B is a diagram describing a display example of the message list; 

FIG. 10 is a diagram illustrating a display example of a client terminal 13-1 ; 

FIG. 1 1 is a diagram illustrating a display example of a client terminal 13-2; 
45 FIG. 1 2 is a diagram illustrating a display example of a client terminal 13-3; 

FIG. 1 3 is a flowchart describing the processing of message 1 ; 

FIG. 1 4 is a diagram illustrating avatar movement in the virtual reality space; 

FIG. 1 5 is a flowchart describing the processing of message 3; 

FIG. 16 is a flowchart describing details of the processing of arm movement in step S24 of FIG. 15; 
so FIG. 1 7 is a flowchart describing details of the processing of leg movement in step S25 of FIG. 1 5; 

FIG. 1 8 is a diagram illustrating another display example on a client terminal ; 
FIG. 19 is a flowchart describing the-processing in which complex movement is started; 

FIG. 20 is a block diagram illustrating an example of the constitution of the cyberspace system practiced as another 
preferred embodiment of the present invention; 
55 FIG. 21 is a diagram describing the WWW (World Wide Web); 
FiG. 22 is a diagram illustrating an example of URL; 

FIG. 23 is a block diagram illustrating an example of the constitution of a mapping server terminal; 

FIG. 24 is a flowchart describing the operations of the client terminal 1 3 (the service provider terminal 1 4); 

FIG. 25 is a flowchart describing the operations of an information server terminal 1 1 A; 



7 



EP 0 753 835 A2 



FIG. 26 is a flowchart describing the operations of a mapping server terminal 12; 
FIG. 27 is a flowchart describing the operations of a shared server terminal 1 1B; 

FIG. 28 is a block diagram illustrating the client terminal 13 practiced as another preferred embodiment of the 
present invention; 

5 FIG. 29 is a diagram describing locations in which basic objects and update objects are stored; 

FIG. 30 is a diagram describing the arrangement of basic objects and update objects; 
FIG. 31 is a diagram describing software for implementing the cyberspace system; 

FIG. 32 is a diagram describing software operating on the client terminal 13-1 and the shared server terminal 1 1 B- 

1 : i 
w FIG. 33 is a diagram describing the environment in which the software operates; 

FIG. 34 is a diagram illustrating a display example on the shared server terminal 1 1 B-1 of FIG. 32; 

FIG. 35 is a diagram illustrating another display example on the shared server terminal 1 1 B-1 of FIG. 32; 

FIG. 36 is a diagram illustrating still another display example on the shared server terminal 1 1B-1 of FIG. 32; 

FIG. 37 is a diagram illustrating yet another display example on the shared server terminal 1 1B-1 of FIG. 32; 
is FIG. 38 is a diagram illustrating a display example on the client terminal 13-1 of FIG. 32; 

FIG. 39 is a diagram illustrating a display example on the shared server terminal 1 1 B-1 of FIG. 32; 

FIG. 40 is a diagram illustrating a display example on the client terminal 13-1 of FIG. 32; 

FIG. 41 is a diagram illustrating another display example on the shared server terminal 1 1 B-1 of FIG. 32; 

FIG. 42 is block diagram illustrating an example of the constitution of a cyberspace system build via the related art 
20 LAN; 

FIG. 43 A is a diagram illustrating a display example in the cyberspace system built via the related art LAN; 
FIG. 43 B is a diagram illustrating another display example in the cyberspace system built via the related art LAN; 
FIG. 43 C is a diagram illustrating still another display example in the cyberspace system built via the related art 
LAN; and 

25 FIG. 44 is diagram illustrating principles of operations of expressing related art avatar walking behavior. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

This invention will be described in further detail by way of example with reference to the accompanying drawings. 
30 The basic idea and,concept of a virtual society is described by Hiroaki Kitano, Sony Computer Science Laborato- 
ries, , as follows in his home page "Kitano Virtual Society (V1 .0) (http7/www.csl,sony.co.jp/person/kitano/VS/con- 
ceptj.html. 1995)": 

"In the beginning of the 21st century, a virtual society would emerge in a network spanning all the world. People in 
every part of the world will make a society in which millions or hundred millions of people live in a shared space created 

35 in the network. A society that will emerge beyond the current Internet, CATV, and the so-called information super high- 
way is a virtual society that I conceive. In the virtual society, people can not only perform generally the same social activ- 
ities as those in the real world-enjoy shopping, have a chat, play games, do work, and the like-but also perform things 
that are possible only in the virtual society (for example, moving from Tokyo to Paris in an instant). Such a "society" 
would be implemented only by state-of-the-art technologies such as cyberspace constructing technologies that support 

40 a broadband network, high-quality three-dimensional presentation capability and bidirectional communications of voice, 
music and moving picture signals, and a large-scale distributed system that allows a lot of people to share the con- 
structed space." 

For further details, look at the above mention home page (URL = httpV/www.csl.sony.co.jp/person/kitano/VS/con- 
cept.j.html). 

45 The three-dimensional virtual reality space that implements the above-mentioned virtual society is a cyberspace 
system. The actual examples of the infrastructures for constructing this cyberspace system includes, at this point of 
time, the Internet, which is a world-wide computer network connected by a communications protocol called TCP/IP 
(Transmission Control Protocol/Internet Protocol) and the intranet implemented by applying the Internet technologies 
such as the WWW (World Wide Web) to the in-house LAN (Local Area Network). Further, use of a broadband commu- 

50 nication network based on FTTH (Fiber To The Home) in the future is proposed in which the main line system and the 
subscriber system are all constituted by fiber optics. 

Meanwhile, for an information providing system available on the Internet, the WWW developed by CERN (Euro- 
pean Center for Nuclear Research) in Switzerland is known. This technology allows a user to browse information includ- 
ing text, image and voice for example in the hyper text form. Based on HTTP (Hyper Text Transfer Protocol), the 

55 information stored in a WWW server terminal is sent asynchronously to terminals such as personal computers. 

The WWW server is constituted by server software called an HTTP demon and an HTML file in which hyper text 
information is stored. The hyper text information is described in a description language called HTML (Hyper Text 
Makeup Language). In the description of a hyper text by HTML, a logical structure of a document is expressed in a for- 
mat specification called a tag enclosed by "<" and ">". Description of linking to other information is made based in link 



8 



BNSOOCtD: <EP 0753835A2J_> 



EP 0 753 835 A2 



information called an anchor. A method in which a location at which required information is stored by the anchor is URL 
(Uniform Resource Locator). 

A protocol for transferring a file described in HTML on the TCP/IP network is HTTP. This protocol has a capability 
of transferring a request for information from a client to the WWW server and the requested hyper text information 
5 stored in the HTML file to the client. 

Used by many as an environment for using the WWW is client software such as Netscape Navigator (trademark) 
called a WWW browser. 

It should be noted that demon denotes a program for executing control and processing in the background when per- 
forming a job in the UNIX environment. 
10 Recently/a language for describing three-dimensional graphics data, called VRML (Virtual Reality Modeling Lan- 

guage) and a VRML viewer for drawing a virtual reality space described in this VRML on a personal computer or a work- 
station have been developed. VRML aHows to extend the WWW, set hyper text links to objects drawn by three- 
dimensional graphics, and follow these links to sequentially access WWW server terminals. The specifications of VRML 
version 1 .0 were made public in May 26, 1 995. Then, in November 9, 1 995, a revised version in which errors and ambig- 
is uous expressions are corrected was made public. The specifications are available from URL = 
http://www.oki.com./vrml/vrml10c.html. 

Storing three-dimensional information described in the above-mentioned VRML in a WWW server terminal allows 
the construction of a virtual space expressed in three-dimensional graphics on the Internet. Further, use of the VRML 
viewer by using personal computers and the like interconnected by the Internet can implement the display of a virtual 
( ; 20 space based on three-dimensional graphics and the walk-through capability. 

In what follows, examples in which the Internet is used for a network will be described. It will be apparent to those 
skilled in the art that FTTH may be used instead of the Internet to implement the virtual space. 

It should be noted that Cyberspace is a coinage by William Gibson, a US science fiction writer, and was used in his 
"Neurornancer" (1984) that made him famous. Strictly speaking, however, the word Cyberspace first appeared in his 
25 "Burning Chrome" (1982). In these novels, there are scenes in which the hero attaches a special electrode on his fore- 
head to connect himself to a computer to directly reflect on his brain a virtual three-dimensional space obtained by vis- 
ually reconfiguring data on a computer network spanning all over the world. This virtual three-dimensional space was 
called Cyberspace. Recently, the term has come to be used as denoting a system in which a virtual three-dimensional 
space is used by a plurality of users via a network. 
30 Now, referring to FIG. 1 , there is shown an example of the constitution of a cyberspace system practiced as one 
preferred embodiment of the present invention. As shown, a given number (in this case, two) of server terminals 1 1 -1 
and 11-2 have storage devices 30-1 and 30-2 respectively and are adapted to provide a virtual reality space via a net- 
work 15 (a global communication network) represented by the Internet for example. In addition, a given number (in this 
case, three) of client terminals 13-1 through 13-3 are installed to receive the virtual reality space and specific services 
35 (information) using the same from the server terminals 11-1 and 1 1-2 via the network 15. 

Further, in the above-mentioned embodiment, a given number (in this case, two) of service provider terminals 14- 
1 and 14-2 are installed to receive the virtual reality space from the server terminals 11-1 and 11-2 via the network 15 
and provide specific services to the client terminals 13-1 through 13-3. 

FIG. 2 shows an example of the constitution of the server terminal 11 (namely, 11-1 and 11-2). As shown, the 
40 server terminal 11 has a CPU 21 . The CPU 21 executes a variety processing operations as instructed by a program 
stored in a ROM 22. A RAM 23 appropriately stores data and a program necessary for the CPU 21 to execute the vari- 
ety of processing operations. A communication device 24 transfers specific data with the network 15 (the Internet). 

A display device 25 has a CRT (Cathode Ray Tube) or an LCD (Liquid Crystal Display) for example and is con- 
nected to interface 28 to monitor images of the virtual reality space provided by the server terminal 11. The interface 28 
45 is also connected with a microphone 26 and a speaker 27 to supply a specific voice signal to the client terminal 13 and 
the service provider terminal 14 and monitor a voice signal coming from these terminals. 

The server terminal 1 1 has an input device 29 on which a variety of input operations are performed via the interface 
28.= This input device has at least a keyboard 29a and a mouse 29b. 
i -FIG. 3 shows an example of the constitution of the client terminal 13 (namely, 13-1 through 13-3). The client termi- 
so nal 13 has a CPU 41 which executes a variety of processing operations according to a program stored in a ROM 42. A 
RAM 43 appropriately stores data and a program necessary for the CPU 41 to executes the variety of processing oper- 
ations. A communication device 44 transfers data to the server terminal 1 1 via the network 15 (the Internet) . 

A display device 45 has a CRT or an LCD to display three-dimensional images created by computer graphics (CG) 
or taken by an ordinary video camera. A microphone 46 is used to output a voice signal to the shared server terminal 
55 1 1 . A speaker 47 outputs the voice signal coming from the server terminal 1 1 . An input device 49 is operated to perform 
a variety of input operations. 

A keyboard 49a of the input device 49 is operated when entering specific characters and symbols. A mouse 49b is 
operated when entering specific positional information. A viewpoint input device 49c is operated when changing the 
state of the avatar (object) as an update object of the client terminal 13. That is, the viewpoint input device 49c is used 
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to enter the viewpoint of the avatar of the client terminal 13. thereby moving the viewpoint of the avatar vertically ; hon- 
zoSv SnT^ direction and zooming a specific image. In addition, the movement ,nput device 49d ,s used to 
nive tne avatar in the forward and backward direction or the right and left Section at a spec-he speed. 

It is apparent that the operations done through the viewpoint and movement input devices may also be done 
through the above-mentioned keyboard 49a and the mouse 49b. cna ^ ar A7 an H an in D ut 

Interface 48 constitutes the data interface with a display device 45. a m.crophone 46 a speaker 47 and aninpirt 
device 4? A storage device 50 composed of a hard disc, an optica, disc, and magneto-optical d.sc stores data and pro- 

9ram RG 4 shows an example of the constitution of the service provider terminal 14 (namely. 14-1 and 1*^™ 

_T 5»" h stnraoe device 60 are generally the same as the components including the CPU 

££££££ <2Z !SS iSZSSZS. - «. <» * -»* *• — «• — 60 



is omitted. 
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FIG 5 schematically shows the three-dimensional virtual reality space (hereinafter appropriately *"J* 
as the virtual reSty space) provided by the server terminal 1 1 of FIG. 1 . As shown, this wtual reality space constitutes 
7Zn ir object) C (the avatar object of the client terrrtna, 13-1 for examp.e) and avatar (update 

obiecttD (the avatar object of the client terminal 13-2 for example) move around. Iit 

2aVr C ^sees an image as shown in FIG. 6 for example from the position and viewpoint in the virtual rea My space 
NanSf an imaS as shown in FIG. 6 is provided to the display device 25 of the client terminal 13-1 from the server 
terminal 11 o be dlp.ayed. Then, when the viewpoint and position of avatar C are changed <*W*<*^J 
viewpoint nput device L and a movement input device 49d (or the keyboard 49a and the 
Ssional image forming the virtual reality space supplied from the server terminal 11 is changed accordingly. 

Z^Tnlge as shown in FIG. 7 is disp.ayed on the display device 45 of the client terminal 13-2 to which 

— hoSS 

virtual reality space) on the display device 45 of the client terminal 13-2 as shown in FIG. 11, 

fn whaHoTows operations' necessary for moving (updating) a specific ££££££ 
subject to change) will be described. For simplicity, it is assumed, as shown in FIG. 8. that .mages of the «^ r ™ 
so spacTseerf from the vS^oints of the avatars of the client terminals 13-1 through 13-3 are displayec I on th ^ 
reiitlely In this example, a conical object 101. a quadrangular prism object 102. and a ^"^fJ^.J" 
frSobiert^ I are delayed It is also assumed that the client terminal 13-1 operates the conical object 101 the client 
^^cSS^q^ular prism object 102. and the client terminaM3-3 operates the cyl.ndnca. object 
in-* hwmpans of the movement input device 49d (or the mouse 49b) to move the objects. 
ss *Z™™ ™™Z Le. in the client terminals 13-1 through 13-3, a message table namely, a change 
seouence teblTas Swn in FIG. 9 A is stored in the ROM 42 or the RAM 43. In the embodiment of FIG. 9 .j! ,™°^f" 
m?nt nesTaae Tis Registered as message number 1 . This movement message specifies an object ID for identifying an 
^SSiiS^SSI of the movement of the object, a velocity at which the object is moved, and a period ,n 



40 

stopped 



50 



55 



^avatar movement message numbered 3 is for moving an avatar, specifying an object ID tor identifying an avatar 
to b.^?.^S^ol the movement of the avatar, and distance of the movement of *e avalar. One ,avata 
s composed a total of five sub objects; a body including a head, a right arm. a left 

the oositions of the arm and leg sub objects of an avatar as the same moves about (namely, to move the avatar wn.ie 
X ^nght an",^ armsLng and the right and left legs alternate), the number of fluctuations (around the joint 
with tho hnriv 1 ! of the arms and legs per unit time is also specified as a parameter. 

i corSlix ^ISat o^art mesLge numbered 4 specifies an object ID for identifying an object that performs a 
co^Z^Z T^L operation stop message numbered 5 specifies an object ID for identifying an object of 

"Tme^g^ 

■ ♦ a i o~o^ of riRPi is PARK to be described later. For example, this message starts a parade in which clowns, sea 

Side is imposed of sub objects such as the clowns, sea dogs, the bear riding on bicycle and the hke. And the sub 
obed S S example is further composed of a total of five sub objects; a body including a head, a nghl arra a 
Main a rigntleg aSa left leg. To make this down walk as it proceeds while swinging its arms and egs forward and 
bTckTn" adrift* to aTleast a direction in which the entire down moves, a velodty at which the entire clown moves, and 
a^SSSSi entire clown continues moving, update information is ^J^^^™ 1 ^ 
per unit time of the sub objects of right arm. left arm, right leg, and left leg around the jomt to the body. In this case, tne 
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fluctuation angles of the objects of right arm, left arm, right leg, and left leg are preset in certain ranges. 

Therefore, in addition to a direction in which the entire parade processes, a velocity at which the entire parade proc- 
esses, and the period in which the entire parade continues processing, the message numbered 6 specifies a heading 
sub object ID1 , a clown for example, a second sub object ID2, a sea dog, a last sub object IDn, the bear riding on bicy- 

5 cle, the number of fluctuation times per unit time around the above-mentioned joint of hand sub objects (right and left) 
of each larger sub object, and the number of fluctuation times per unit time around the abovementioned joint of leg sub 
objects (right and left) of each larger sub object. In this case, it will be apparent that the different numbers of fluctuation 
times may be set to the hand and teg sub objects of different larger sub objects of downs, sea dogs, and the bear, 
thereby expressing complex proceeding behaviors as the parade in its entirety. 

io For a simple example, it is assumed that, in the client terminal 1 3-1 , the conical object 101 (an update object) is 
moved from the position of dotted line to the position of solid line. When the movement input device 49d or the mouse 
49b of the client terminal 13-1 is operated to instruct the CPU 41 to move the conical object, the CPU 41 generates the 
movement message of number 1. Namely, the object ID of the conical object 101 is set as the ID of the object to be 
moved. In addition, specific values are set for the direction, velocity, and period of movement according to the inputs 

is (the operation of the input devices). 

For example, as will be described, if the setting is made such that, when the mouse 49b is moved up with the left 
button kept pressed, the object moves forward at a velocity corresponding to the distance of the movement of the 
mouse 49b, the direction (in this case, upward), the velocity (in this case, the distance of the movement of the mouse 
49b), and the period (in which the mouse has been operated) are detected by the CPU 41 to be set in memory. 

20 Then, the CPU 41 executes the message that was created by itself. Namely, image data are generated such that 

the conical object 1 01 moves to the position from the position of dotted line to the position of solid line as shown in FIG. 
10. which is outputted to the display device 45 to be displayed. 

Further, the CPU 41 of the client terminal 13-1 controls the communication device 44 to transmit the generated 
movement message to the server terminal 11-1 via the network 15. Receiving the movement message via the commu- 

25 nication device 24, the CPU 21 of the server terminal 1 1 -1 outputs the received movement message to the client termi- 
nals 13-2 and 13-3 from the communication device 24 simultaneously. 

Receiving the movement message via the communication device 44, the CPU 41 of the client terminal 13-2 exe- 
cutes the processing specified in the received movement message. To be more specific, from this movement message, 
the CPU 41 identifies the conical object 101 as the object to be moved, reads, from this movement message, the move- 

30 ment direction, velocity and period in the virtual reality space, generates data of an image for moving the conical object 
101 in the virtual reality space, and displays the generated image data on he display device 45. The similar processing 
is performed on the client terminal 13-3. Consequently, the conical object 101 appears moving on the display devices 
45 of the client terminals 1 3-2 and 13-3 in synchronisation as shown in FIGS. 1 1 and 12. 

Namely, in the above-mentioned case, the image for moving the conical object. 101 is locally generated on each of 

35 the client terminals 13-1 through 13-3 to be displayed, rather than that the server T1-1 generates the image for moving 
the conical object 101 to supply" the same to the client terminals 13-1 through 13-3. Consequently, the volume of com- 
munication between the client terminals 13-1 through 13-3 and the server terminal 11-1 can be minimized. 

It should be noted that, since the message is received via the network 15, the display on the client terminals 13-2 
and 13-3 is delayed slightly behind the display on the client terminal 13-1. However, the client terminal 13-1 transmits 

40 the message immediately after generating the same, the display on all client terminals is driven generally in synchroni- 
zation in practice. The server terminal 11 transmits the message to the client terminals 13-2 and 13-3 generally at the 
same time, so that it is assumed that the display on the client terminals 13-2 and 13-3 is driven generally in synchroni- 
zation. s 

FIG. 13 shows the processing to be performed when the client terminals 13-1 through 13-1 receive the message 1 . 

45 To be more specific, in the first step Si , the object to be moved is read from the object ID of the movement message 

number 1 and the object thus read is set. Then, in steps S2 and S3, the direction and velocity specified by. the param- 
eters of the movement message are read and set. Then, in step S4, the image data are generated which move the 
object set in step S1 in the direction set in step 2 at the velocity set in step S3. The generated image data are outputted 
to the display device 45 to be displayed. 

so Then, in step S5, it is determined whether the period specified in the movement message has passed or not If the 

period has not passed, then, back in step S4, the processing for moving the object is continued. Thus, the movement 
(update) of the object is continued until the period specified in the movement message passes. 

If the period specified in the movement message has been found passed in step S5, then, in step S6, it is deter- 
mined whether another message has been entered or not. If there is any other message, then, in step S7, the object 
. 55 ■ kept moving so far is stopped. If another message has been found in step S6. then, in step S8. the processing of the 
new message is performed. This allows to move the conical object 101 for example during a specific period, followed 
by the execution of next processing. 

If a movement message is entered again as a next message, the object is moved for a further specific period. 
. In what follows, the movement of an avatar in a more complex manner will be described. As shown in FIG. 1 4, it is 
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assumed that the virtual reality space in which the conical object 101 . the quadrangular 

drical object 103 exist contains avatars C through E corresponding to the chent terminals 13-1 through 13-3 respec- 
tively 

Now, it is assumed that, in the client terminal 13-3. an operation is made on the mouse 49b to move the avatar E 
s in the direction indicated by the arrow in FIG. 14. At this moment, in response to this operat.on. the CPU 41 o the chent 
ermtfa. its generates an avatar movement message of number 3 shown in FIG. 9 Namely as an avatar (an update 
object) to be moved, the object ID for the avatar E is set. Also, the direction in wh.ch the avatar .s moved and he dis- 
tance o the movement aresat corresponding to the inputs from the input device 49. Further, for the - 
the arms (sub objects) and legs (sub objects) of the avatar E. the number of fluctuation times per un.t time is set as 
w required Unless especially specified, a" default is set for the number of fluctuation times. 

Tne above-mention ed avatar movement message is executed on the client terminal 13-3 and. at the same , tm* 
transmitted to the client terminals 13-1 and 13-2 via the server terminal 1 1-1 at the same time to be executed as shown 

in the flowchart of FIG. 15. . C1 _ . th „ camo « mp i n 

To be more specific, the client terminals 13-1 through 1 3-3 start a program shown ,n FIG. 15 at the same _t,me In 
is step S21 . the object ID is read from the avatar movement message and the object ID thus read is set. In step S22. the 

mOV Furthlr d 'ir??tep S23(an update sequence), the image data in the case in which the object set in step S21 is moved 
in the direction set in step S22 are generated. The generated image data are outputted to the display dev.ce 45 to be 

d,SP T?lS' the avatar E moves on the display devices of the client terminals 13-1 through 13-3 in synchronization. 

In addition, in steps S24 and S25. the movement processing operations of the arms and legs, independent obiects. 

Sails Sthe processing of arm fluctuating movement (an update sequence) are shown in the flowchart of FIG. 1 6. 
First, in step S41 . the number of times the arm fluctuates is read from the specifications of the 

sage and the number thus read is set. Then, in step S42. the image for fluctuating the arms of the °b.ect (,n this case 
the arms of the avatar E) by the number of times set in step S41 is generated. The generated image is outputted to the 
display device 45 to be displayed. ■ 

Thus when the avatar E is moved in step S23 of FIG. 1 5. the image in which the arms of the avatar E (in this case, 
a part of the plurality of objects constituting the avatar E) fluctuate back and forth is displayed _ 
Details of the processing of leg fluctuating movement (an update sequence) are shown ,n the flowchart of FIG. 17 
In step S5 1 . the number of times the leg fluctuates is read from the specifications of the avatar movemen t menage and 
the' number thus read is set. Then, in step S52. the CPU 41 generates the image data for tlucl^ *gs ^of the 
object (the avatar E) by the number of times set in step S51. The generated image data are outputted to the d.splay 

deVi Thus 5 l^theavatar E is moved in step S23 of FIG. 15. the image in which the hands are fluctuated back and 
forth in step S24 and the legs are fluctuated alternately in step S25 is displayed. „ tore/ . Qn 
By setting the number of fluctuation times per unit time of the arms and legs to specrf.c values, drfferent avatars can 
be made to move their arms and legs differently from those of other avatars. For example if a ta avatar and a short 
avatar are walking at a same velocity, setting the number of fluctuation times of the legs of the tall avatar to a smaller 
40 value than that of the short avatar can make the walking behavior more natural. ra/( T h m w 0 « m 

For the number of fluctuation times of arms and legs, defaults (an update sequence) are prepared. Therefore, f no 
command for the number of fluctuation times of arms and legs has been entered from the input device 49 of the client 
terminal 13 or a command (an update sequence) for simply moving a specific avatar in a specrf.c d.rect.on has been 
entered, the avatar is displayed with its arms and legs moving in a generally natural manner - . 

4S Then in step S26 of FIG. 15 from step S25, it is determined whether the moving (walking) avatar has moved by the 

distance set according to the specification in the avatar movement message. If the avatar is found not having walked 
the speeded distance then, back in step S23, the processing is repeated; namely, the avatar is made continue walking 
In step S26, if the avatar is found having walked the specified distance, then, ,n step S27, ,t ,s determined whether 
a next message has entered or not. If no new message is found, then, in step S28, the proem , to stop *e moving 
so avatar is performed, this processing can be performed by generating the.stop message numbered 2 of FIG. 9 for exam- 
pi. to execute the same, stopping the avatar. However, a setup can also be made such 

automatically stopped if there is no new message when the same has walked the specified d.stance (or the specf .ed 

^'^step S27. if the new message is found, then, in step S29. the processing specified in the ne« * 
55 formed. For example, if the new message is the stop message numbered 2. the stop processing ,s performed m step 
S29 thereby stopping the walking avatar. ^^il.^hmi 
Thus, the avatar can be moved with ease with a relatively small amount of communication and in a generally natural 

Itshould be noted that the server terminal 11-1 controls the clock of the three-dimensional virtual reality space and. 
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when a predetermined time comes, transmits a parade start message numbered 6 to each of the client terminals 13-1 
through 13-3. This also allows the abovementioned parade of the message numbered 6 to be implemented only by 
using message communication volume in the same processing shown in FIGS. 1 5 through 17. 

Based on the above-mentioned principles of operations, more complex behaviors can also be implemented with 

5 relatively small amount of communication. 

For example, as shown in FIG. 1 8, it is assumed that a sidewalk 1 1 2 is provided along a road 1 1 1 with a billboard 
1 1 3 installed in the proximity of the sidewalk 1 1 2 in a virtual reality space. The billboard 1 13 is set up such that the same 
displays a predetermined advertisement when an avatar (avatar F in FIG. 18) comes within a predetermined range. 
In this case, the server terminal 11-1 receives the positional data of the avatars from the client terminals 13-1 

io through 13-3 respectively to calculate the distance between each avatar and the billboard 113. When the distance is 
found smaller than a predetermined level, the server terminal 1 1-1 generates the complex movement start message 
numbered 4 and outputs the generated message to the client terminals 1 3-1 through 13-3. Upon receiving this complex 
movement start message, the CPU 41 of each of the client terminals 13-1 through 13-3 executes the processing (an 
update sequence) indicated in the flowchart of FIG. 19. 

75 To be more specific, first in step S61 , the billboard 1 13 of FIG. 18 is turned on. Then, in step S62, predetermined 

characters and graphics for example are displayed on the billboard 113 according to a predetermined sequence. Then, 
in step S63. it is determined whether the complex movement stop message numbered 5 has been entered or not. If the 
complex movement stop message has not been found, then, back in step S62, the display on the billboard 113 is con- 
tinued. 

20 The server terminal 11-1 always monitors the distance between avatar F in the proximity of the billboard 1 1 3 an the 

billboard 1 1 3. When this distance becomes greater than the preset level, the server terminal 11-1 generates the com- 
plex movement stop message numbered 5 to output the same to the client terminals 13-1 through 13-3. 

In step S63 of FIG. 19, upon reception of this message, the CPU 41 of the client terminal 13 goes to step S64 to 
turn off the billboard 113. Namely, the complex movement performed on the billboard 1 13 is stopped. 

25 Thus, even tor complex movements (update sequences), simply registering the same in the client terminals 13-1 

through 13-3 in advance allows the client terminals 13-1 through 13-3 to display complex movement images simply by 
outputting a message for indicating their start to the client terminals 1 3-1 through 1 3-3. 

In the above-mentioned embodiment, the two server terminals and the three client terminals are connected via the 
network. It will be apparent to those skilled in the art that the number of terminals and networks is not limited to these 

30 values. 

It -should be noted that displaying avatars C through F in addition to the above-mentioned conical object 101, the 
quadrangular prism object 102, and the cylindrical object 103 also requires objects that provide a background. The 
basic states of the background objects are not subject to change, so that these objects are referred to as basic objects 
as contrasted with the update objects of which states are subject to change. A background image formed by basic 
35 objects is supplied from the server terminal 1 1 to the client terminal 13 via the Internet. Therefore, the update objects 
are displayed superimposed on the background image (basic objects). 

Meanwhile, in the above-mentioned related art Habitat, an animation in which an avatar moves while fluctuating its 
arms and legs on a two-dimensional background is displayed when the cursor is moved to a target position to which an 
avatar is to be moved, the mouse button is kept pressed on that position to display a mouse command (a pop-up menu), 
40 and "GO" command in the pop-up menu is clicked. However, this is the display in which the avatar created by two- 
dimensional graphics is superimposed on the background image created by two-dimensional graphics, namely the dis- 
play based on the animation created by a series of celluloid pictures in which bit map data representing different direc- 
tions of the arms and legs are alternately read out as the avatar moves along. 

Namely, in Habitat, a two-dimensional virtual reality space can be viewed only from a position viewing over the 
45 entire space including one's own avatar from the viewpoint of a third person. Therefore, it is impossible for Habitat to 
change viewpoints or represent a depth. 

On the contrary, in the above-mentioned embodiment of the present invention, the update sequences of the ava- 
tar's arms and legs (each sub object) may be defined in advance such that the update sequences interlock with each 
other. This allows the avatar to perform a variety of behaviors which are minutely different from each other according to 
so the attributes of the avatar simply by giving a message "walk" for example to the avatar (for example, a male avatar is 
made walk with a big stride while a female avatar with a small, feminine stride). 

It should be noted that the data of each object are defined as a VRML file or an E-VRML file, details of which will 
be described later. 

In the above-mentioned embodiment of the present invention, each client terminal 13 moves its object. It is also 
55 possible to display on each client terminal the image of a virtual reality space seen from the viewpoint of each corre- 
sponding avatar. When the viewpoint is moved on each client terminal, the background image changes corresponding 
to the viewpoint. If an avatar of another client terminal is found within the view field range seen from that viewpoint, that 
avatar is displayed. Therefore, the avatar display state is a result of the composition of a movement command from that 
client terminal to that avatar. This makes control of the display more complex. 



13 



nnerw>in- ,cn 



EP 0 753 835 A2 



70 



75 



FIG 20 shows a more concrete example of the constitution of a cyberspace system based on the Internet In the 
preferred embodiment, one of the above-mentioned server terminals 1 1 -1 and 1 1 -2 (for example, the server terminal 
11 -1) is used as an information server terminal and the other (the server terminal 1 1 -2) .s used as a shared server ter- 
minal. In what follows, therefore, the server terminal 11-1 denotes the information server terminal 11A while the server 
terminal 1 1 -2 denotes the shared server terminal 1 1 B. 

A host A constitutes a system of the WWW (World Wide Web) for example. Namely, the host A has information (or 
a file) to be described later.- And. each piece of information (or each file) is related with a URL (Uniform Resource Loca- 
tor) for uniformly specify that information. Specifying a URL allows access to the informati on corresponding to rt. 

To be more specific, the host A stores three^Jimensional image data for providing three<i.mens,onal virtual realty 
spaces (hereinafter appropriately referred to simply as virtual reality spaces) such as virtual streets ,n Tokyo New York 
and other locations for example. It should be noted that these three-dimensional .mage data do not change n their base 
state- that is these data include static data consisting of only basic objects such as a building and a road to be shared 
by a plurality of users. If the basic state changes, it only reflects an autonomous change in the state of a merry-go-round 
or a neon. The static data are considered to be data that are not subject to update. The host A has an information server 
terminal 1 1A (a basic server terminal). The information server terminal 1 1 A is adapted, when the same receives a URL 
via the network 1 5. to provide the information corresponding to the received URL, namely a corresponding virtual realty 
space (in this case, a space consisting of only basic objects). ^ 

It should be noted that, in FIG. 20. there is only one host, namely the host A. wh.ch has an .nformat.on server ter- 
minal for providing the virtual reality space (consisting of only basic objects) of a specie area. It .s apparent that such 

20 a host may be installed in plural. . _ 

A host B has a shared server terminal 1 1 B. The shared server terminal 1 1 B controls update objects that constitute 
a virtual reality space when put in it. The update objects are avatars for example representing users of the ^termi- 
nals Thus the shared server terminal 1 1 B allows a plurality of users to share the same virtual realty space. It should 
be noted, however, that the host B controls only the update objects located in a virtual reality space for only ajP«** 
area (for example. Tokyo) of the virtual realty spaces controlled by the host A. That is. the host B is dedicated o the 
virtual reality space of a specific area. Also, ft should be noted that the network 15 is connected with, in addition to the 
host B. a host, not shown, having a shared server terminal for controlling update objects located .n virtual realty spaces 
of other areas such as New York and London, stored in the host A. 

A host C like the host A. constitutes a WWW system for example and stores data includ.ng IP (Internet Protocol) 
addresses for addressing hosts (shared server terminals) that control update objects like the host B. Therefore, the 
shared server terminal addresses stored in the host C are uniformly related with URLs as with the case of the host A 
as mentioned above. In addition, the host C has a mapping server terminal 12 (a control server terminal). Receiving a 
URL via the network 15, the mapping server terminal 12 provides the IP address of the shared server terminal corre- 
sponding to the received URL via the network 15. It should be noted that FIG. 20 shows only one host, namely the * host 
C which has the mapping server terminal 1 2 for providing shared server terminal addresses. It will be apparent that the 

host C can be installed in plural. ■ . „,.,.,» 

The client terminal 13 (13-1 . 13-2 or 13-3) receives a virtual reality space from the information server terminal 1 1A 
via the network 15 to share the received virtual reality space with other client terminals (including the service provider 
terminal 14) under the control of the shared server terminal 11B. Further, the client terminal 13 is also adapted to 
receive specific services (information) using the virtual reality space from the service provider term.nal 14 

The service provider terminal 14, like the client terminal 13, receives a virtual reality space to share the same with 
the client terminal 13 (if there is another service provider terminal, it also shares this space). Therefore as far as the 
capability ol this portion is concerned, the service provider terminal 1 4 is the same as the cl.ent terminal 13, 

Further the service provider terminal 14 is adapted to provide specific services to the client terminal 13. It should 
be noted that FIG. 20 shows only one service provider terminal 14. It will be apparent that the service provider term.nal 
may be installed in plural. _,_ _ . , 

The following briefly describes a WWW system constituted by the host A and the host C. Refemng to FIG. 21 the 
WWW is one of the systems for providing information from hosts X. Y. and Z to unspecified users (client terminals) via 
the network 15 (the Internet in the case of the WWW). The information that can be provided in th.s system include not 
only texts but also graphics, images (including still images and moving pictures), voices. three^Jimensional ..mages, and 
hyper texts which combines all these information. 

In the WWW a URL. or a form for uniformly represent these pieces of information is determined. Specifying a spe- 
cific URL. each user can obtain the information corresponding to the specified URL As shown in FIG 22. eac .URL is 
composed of a protocol type for representing a service type (http in the preferred embodiment of FIG 22. which* 
equivalent to a command for retrieving a file corresponding to a file name to be described later and send the retrieved 
fTe) a host name indicating a destination of the URL (in the embodiment of FIG. 22. www.csl.sony.co.jp). and a f.le 
name of data to be sent (in the embodiment of FIG. 22, index.html) for example. 

Each user operates the client terminal to enter a URL for desired information. When the URL .s entered the client 
terminal references a host name, for example, contained in the URL. A link with a host (in the embod.ment of FIG. 21 . 
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the host X for example connected to the Internet) addressed by the host name is established. Then, at the client termi- 
nal, the URL is sent to the linked host, namely the host X, via the Internet, requesting the host X for sending the infor- 
mation specified in the URL In the host X, an HTTP demon (httpd) is operating on the information server terminal (the 
WWW server terminal). Receiving the URL, the information server terminal sends back the information specified in the 

5 URL to the client terminal via the Internet. 

The client terminal receives the information from the information server terminal to display the received information 
on its monitor as required. Thus, the user can get the desired information. 

Therefore, only storing in the host such data for describing elements (objects) for constituting a virtual reality space 
as shapes of basic objects (for example, a rectangular prism and a cone) and locations and attributes (color and texture 

w for example) of these basic objects allows to provide the virtual reality space (consisting of only basic objects in this 
case) to unspecified users. Namely, as long as the. Internet is used for the network 15 and the WWW is used, virtual 
reality spaces can be provided to unspecified users world-wide with ease and at a low cost because the Internet itself 
already spans almost all over the world and the description of the elements constituting each virtual reality space to be 
stored in hosts does not require to make changes to information servers (WWW server terminals) constituting the 

75 WWW. It should be noted that the service for providing the description of the elements constituting a virtual reaiity 
space is upward compatible with existing services provided by the WWW. 

Storing in a specific host (a mapping server terminal) the IP addresses of other hosts as information also allows to 
provide the host IP addresses to unspecified users world-wide with ease. 

It should be noted that it is difficult for a plurality of users to share the same virtual reality space if only the descrip- 

20 tion (the data of three-dimensional image for providing the virtual reality space of a specific area) of elements constitut- 
ing the virtual reality space is stored in a host constituting the WWW. Namely, in the WWW, the information 
corresponding to a URL is only provided to a user and therefore no control for information transfer is performed. Hence, 
it is difficult to transfer between users the above-mentioned change information of update objects by using the WWW 
without changing its design. Therefore, in the cyberspace system of FIG. 20. the host B having the shared server ter- 

25 minal 1 1B and the host C having the mapping server 1 2 are installed to allow a plurality of users to share the same vir- 
tual reality space, details of which will be described later. 

FIG. 23 shows an example of the constitution of the mapping server terminal 1 2 operating on the host C of FIG. 20. 
Components CPU 91 through communication device 94 are generally the same in constitution as those of FIG. 2, so 
that the description of the components of FIG. 23 is omitted in general. A storage device 95 stores addresses, along 

30 with URLs, for identifying shared server terminals that control update objects (in the embodiment of FIG. 20, only the 
shared server terminal 11 B is shown; actually, other shared server terminals, not shown, are connected to the network 
15). ' 

The following describes the operations of the client terminal 1 3 (or the service provider terminal 1 4), the information 
server terminal 11 A, the mapping server terminal 12, and the shared server terminal 1 1B with reference to the fiow- 

35 charts of FIGS. 24 through 27. 

Now, referring to FIG. 24, there is shown an example of processing by the client terminal 1 3 (or the service provider 
terminal 14). In step S71 , the CPU 41 checks whether a virtual reality space URL has been entered or not. If no virtual 
reality space URL has been found, the processing remains in step S71 . If a virtual reality space URL has been found 
in step S71, namely, if a virtual reality space URL corresponding to a desired virtual reality space entered by the user 

40 by operating the keyboard 49a has been received by the CPU 41 via interface 48, the process goes to step S72. In step 
S72, a WWW system is constituted as described with reference to FIG. 21 and the virtual reality space URL is trans- 
mitted from the communication device 44 via the network 15 to the information server terminal of a specific host (in this 
caS e ( the information server terminal 11 A of the host A for example) that has the information server terminal, thereby 
establishing a link. 

45 Further, in step S21 , an address acquisition URL related to the virtual reality space URL is read from the storage 

device 50 to be transmitted from the communication device 44 via the network 1 5 to the mapping server terminal of a 
specific host (in this case, mapping server terminal 12 of the host C for example) that constitutes the WWW system, 
thereby establishing a link. 

Then, the process goes to step S73. In step S73, data (three-dimensional image data) of the virtual reality space 
so or the IP address of the shared server terminal 1 1 B corresponding to the virtual reality space URL received in step S72 
or the address acquisition URL is received by the communication device 44. 

Namely in step S72. the virtual reality space URL is transmitted to the information server terminal 1 1 A. When this 
virtual reality space URL is received by the information server terminal 1 1 A, the data of the corresponding virtual reality 
space are transmitted to the client terminal 13 via the network 15 in step S92 of FIG. 25 to be described. Thus, in step 
55 S73. the data of the virtual reality space transmitted from the information server terminal 1 1 A are received. It should be 
noted that the received virtual reality space data are transferred to the RAM 43 to be stored there (or first stored in the 
storage device 50 to be transferred to the RAM 43. 

Also, in step S72, the address acquisition URL is transmitted to the mapping server terminal 12. When the address 
acquisition URL is received by the mapping server terminal 12, the IP address of the shared server terminal corre- 
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spending to the URL is transmitted to the client terminal 13 via the network 15 in step S102 of FIG. 26 to be described. 
Thus, in step S73. the IP address of the shared server terminal 1 1 B transmitted from the mapping server 12 is received. 

As described above, the address acquisition URL related to the entered virtual reality space URL corresponds to 
the IP address of the shared server terminal that controls the update object placed in the virtual reality space corre- 
s spending to that virtual reality space URL. Therefore, for example, if the entered virtual reality space URL corresponds 
toa virtual reality space of Tokyo and the shared server terminal 1 1B owned by the host B controls the update objects 
placed in the Tokyo virtual reality space, the IP address of the shared server terminal .1 1 B is received in step S73 Con- 
sequently the user can automatically get the location (the IP address) of the shared server terminal that controls the 
virtual reality space of a desired area even if the user does not know which shared server term.nal controls the update 
10 objects in a virtual reality space in whicli area. , ix . ,_. „„ H+Ko 

It should be noted that, in steps S72 and S73. the processing of transmitting the virtual reality space URL and the 
address acquisition URL and receiving the virtual reality space data and the IP address is actually performed by trans- 
mitting the virtual reality space URL. receiving the data of the corresponding virtual reality space, transm.ttmg the 
address acquisition URL. and then receiving the corresponding IP address in this order by way of example. 
is When the virtual reality space data and the shared server terminal IP address are received in step S73. the process 
goes to step S74 In step S74, a connection request is transmitted from the communication device 44 v.a the network 
15 to the shared server terminal (in this case, the shared server terminal 11B for example) corresponding to the IP 
address (the shared server terminal IP address) received in step S73. This establishes a link between the client termi- 
nal 13 and the shared server terminal 1 1 B. Further, in step S73, after the establishment of the link, the avatar (namely. 
20 the update object) representing oneself stored in the storage device 50 is transmitted from the commun.cat.on dev.ee 
44 to the shared server terminal 1 1 B. 

When the shared server terminal 1 1B receives the user's avatar, the same is then transmitted to the chert terminals 
of other users existing in the same virtual reality space (in this case, that of Tokyo as mentioned above). Then, on the 
client terminals of other users, the transmitted avatar is placed in the virtual reality space, thus implement.ng the sharing 
25 of the same virtual reality space among a plurality of users. 

It should be noted that, rather than providing the user's avatar from the client terminal 1 1 B to the shared server ter- 
minal 11B a predetermined avatar may also be allocated from the shared server terminal 11B to each user who 
accessed the same. Also, in the client terminal 1 3. the avatar of the user himself who uses this terminal can be placed 
and displayed in the virtual reality space as shown in FIGS. 36 and 37; in the real world, however, the user cannot see 
himself, so that it is desirable for the user's avatar not be displayed on that user's client terminal in order to make the 
virtual reality space as real as possible. 

When the processing of step S74 has been completed, the process goes to step S75. In step S75. the data of the 
virtual reality space that can be seen when the same is seen from specific viewpoint and position are read from the 
RAM 43 by the CPU 41 to be supplied to the display device 45. Thus, the specific virtual reality space is shown on the 
35 display device 45. 

Then, in step S76. the communication device 44 determines whether update information of another user s avatar 
has been sent from the shared server terminal 11 B. 

As described above, the user can update the position or viewpoint of his own avatar by operating the viewpoint 
input device 49c the movement input device 49d or mouse 49b. If the update of the position or viewpoint of the avatar 
is instructed by using this capability, the CPU 41 receives the instruction via the interface 48. According to the instruc- 
tion the CPU 41 performs processing for outputting positional data or viewpoint data corresponding to the updated 
position or viewpoint as update information to the shared server terminal 1 1B. In other words, the CPU 41 controls the 
communication device 44 to transmit the update information to the shared server terminal 1 1 B. 

Receiving the update information from the client terminal, the shared server terminal 1 1 B outputs the update infor- 
mation to other client terminals in step S1 14 of FIG. 27 to be described. It should be noted the shared server terminal 
1 1 B is adapted to transmit the avatar received from the client terminal that requested for access to client terminals of 
other users, this avatar being transmitted also as update information. 

When the update information has come as mentioned above, it is determined in step S76 that update information 
of the avatar of another user has come from the shared server terminal 11B. In this case, this update information is 
received by the communication device 44 to be outputted to the CPU 41 . The CPU 41 updates the display on the d.splay 
device 45 according to the update information in step S77. That is. if the CPU 41 receives the positional data or view- 
point data from another client terminal as update information, the CPU 41 moves or changes (for example, the orienta- 
tion of the avatar) the avatar of that user according to the received positional data or viewpoint data. In addition, if the 
CPU 41 receives the avatar from another client terminal, the CPU 41 places the received avatar in the currently dis- 
ss played virtual reality space at a specific position. It should be noted that when the shared server terminal 1 1 B .transmits 
an avatar as update information, the shared server terminal also transmits the positional data and viewpoint data of the 
avatar along with the update information. The avatar is displayed on the display device 45 according to these positional 

data and viewpoint data. 

When the above-mentioned processing has come to an end, the process goes to step S78. 
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Meanwhile, il, in step S76, no update information of the avatar of another user has come from the shared server 
terminal 1 1B, the process goes to step S78, skipping step S77. In step S78, the CPU 41 determines whether the posi- 
tion or viewpoint of the avatar of the user of the client terminal 13 has been updated or not by operating the viewpoint, 
input device 49c or the movement input device 49d. 

5 In step S78, if the CPU 41 determines that the avatar position or viewpoint has been updated, namely, if the view- 

point input device 49c or the movement input device 49d has been operated by the user, the process goes to step S79. 
In step S79, the CPU 41 reads data of the virtual reality space corresponding to the position and viewpoint of the avatar 
of the user based on the entered positional data and viewpoint data, makes calculations for correction as required, and 
generates the image data corresponding to the correct position and viewpoint. Then, the CPU 41 outputs the generated 

w image data to the display device 45. Thus, the image (virtual reality space) corresponding to the viewpoint and position 
entered from the viewpoint input device 49c and the movement input device 49d is displayed on the display device 45. 

Further, in step S80, the CPU 41 controls the communication device 44 to transmit the viewpoint data or the posi- 
tional data entered from the viewpoint input device 49c or the movement input device 49d to the shared server terminal 
1 1 , upon which process goes to step S81 . 

is Here, as described above, the update information coming from the client terminal 13 is received by the shared 

server terminal 1 1 B to be outputted to other client terminals. Thus, the avatar of the user of the client terminal 13 is dis- 
played on the other client terminals. 

On the other hand, in step S78, if CPU 41 determines that the avatar's position or viewpoint has not been updated, 
the process goes to step S81 by skipping steps S79 and S80. In step S81 , the CPU 41 determines whether the end of 

20 the update data input operation has been instructed by operating a predetermined key on the keyboard; if the end has 
not been instructed, the process goes back to step S76 to repeat the processing. 

Referring to the flowchart of FIG. 25, there is shown an example of the processing by the information server termi- 
nal 1 1 A. First, in the information server terminal 1 1 A, the communication device 24 determines in step S91 , whether a 
virtual reality space URL has come from the client terminal 13 via the network 15. If, in step S91 , the communication 

25 device 24 determines that no virtual reality space URL has come, the process goes back to step S91 . If the virtual real- 
ity space URL has come, the same is received by the communication device 24, upon which the process goes to step 
S92. In Step S92, the data of the virtual reality space related to the virtual reality space URL received by the communi- 
cation device 24 are read by the CPU 21 to be transmitted via the network 15 to the client terminal 13 that transmitted 
the virtual reality space URL. Then, the process goes back to step S91 to repeat the above-mentioned processing. 

30 FIG. 26 shows an example of the processing by the mapping server terminal 1 2. In the mapping server terminal 1 2, 

the communication device 24 determines in step S101 / whether an address acquisition URL has come from the client 
terminal 13 via the network 15. If no address acquisition URL has come, the process goes back to step S101. If the 
address acquisition URL has come, the same is received by the communication device 24, upon which the process 
goes to step S102. In step S102, the IP address (the IP address of the shared server terminal) related to the address 

35 acquisition URL received by the communication device 24 is read from the storage device 30 by the CPU 21 to be trans- 
mitted via the network 15 to the client terminal 1 3 that transmitted the address acquisition URL Then, the process goes 
back to step S1 01 to repeat the above-mentioned processing. 

FIG. 27 shows an example of the processing by the shared server terminal 1 1 B. In the shared server terminal 1 1 B, 
the communication device 24 determines, in step Si 1 1 , whether a connection request has come from the client termi- 
te nal 13 via the network 15. If no connection request has come in step S1 1 1 . the process goes to step S1 13 by skipping 
step S112. If the connection request has come in step S1 11, that is, if the client terminal 13 has the connection request 
to the shared server terminal 1 1 B in step S74 of FIG. 24, the communication link with the client terminal 13 is estab- 
lished by the communication device 24, upon which the process goes to step S1 12. 

In step S1 12, a connection control table stored in the RAM 23 is updated by the CPU 21 . Namely, it is necessary 

45 for the shared server terminal 11 B to recognize the client terminal 13 with which the shared server terminal 11B is 
linked, in order to transmit update information coming from the client terminal 13 to other client terminals. To do so, 
when the communication link with client terminals has been established, the shared server terminal 1 1 B registers the 
information for identifying the linked client terminals in the connection control table. That is, the connection control table 
provides a list of the client terminals currently linked to the shared server terminal 1 1B. The information for identifying 

so the client terminals include the source IP address transmitted from each client terminal as the header of TCP/IP packet 
and a nickname of the avatar set by the user of each client terminal. 

Then, the process goes to step S1 1 3. in which the communication device 24 determines whether the update infor- 
mation has come from the client terminal 1 3. rf, in step S1 1 3, no update information has been found, the process goes 
to step S1 1 5 by skipping step S1 1 4. If the update information has been found in step Si 1 3. namely, if the client terminal 

55 13 has transmitted, in step S80 of FIG. 24, positional data and viewpoint data as the update information to the shared 
server terminal 1 1 B (or, in step S74 of FIG. 24, the client terminal 13 has transmitted the avatar as the update informa- 
tion to the shared server terminal 1 1B after transmission of the connection request), the update information is received 
by the communication device 24, upon which the process goes to step S1 14. In step S1 14, the CPU 21 references the 
connection control table stored in the RAM 23 to transmit the update information received by the communication device 
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the mapping server terminal 12 via the Internet 15A. 

In the case 4, the basic object data are stored in advance in the storage device 50 of the client terminal 13-1 in 
Japan for example. The update object data are supplied from the shared server terminal 1 1 -2 in US for example spec- 
ified by the client terminal 13-1. 

5 In the case 5. the basic object data are stored in advance in the storage device 50 of the client terminal 13-1. The 

update object data are supplied from the shared server terminal 1 1 B-1 in Japan specified by the mapping server termi- 
nal 12 via the Internet 15A. 

In the case 6, the basic object data are stored in advance in the storage device 50 of the client terminal 13-2 in US. 
The update object data are supplied from the shared server terminal 1 1 -2 in US specified by the mapping server termi- 
io nal 12 to the client terminal 13-2 via the Internet 15A. 

In the case 7, the basic object data stored in the CD-ROM 101 are supplied to the client terminal 13-1 in Japan for 
example via the CD-ROM drive 1 00. The update object data are supplied from the shared server terminal (for example, 
the shared server terminal 11-1 or 11-2) specified by the client terminal 13-1. 

In the case 8, the basic object data are supplied from the CD-ROM 101 to the client terminal 13-1. The update 
15 object data are supplied from the shared server terminal 1 1 B-1 in Japan specified by the mapping server terminal 1 2 in 
Japan. 

In the case 9, the basic object data are supplied from the CD-ROM 101 to the client terminal 13-2 in US. The update 
object data are supplied from the shared server terminal 1 1 -2 in US specified by the mapping server terminal 1 2 via the 
Internet 15A. 

.■: 20 Iri what follows, the software for transferring the above-mentioned virtual reality space data to display the same on 

the display device. In the WWW system, document data are transferred in a file described in HTML (Hyper Text Markup 
Language). Therefore, text data are registered as an HTML file. 

On the other hand, in the WWW system, three-dimensional graphics data are transferred for use by describing the 
same in VRML (Virtual Reality Modeling Language) or E-VRML (Enhanced Virtual Reality Modeling Language). There- 
25 fore, as shown in FIG. 31 for example, a WWW server terminal 1 12 of remote host 1 1 1 constituting the above-men- 
tioned information server terminal 1 1 A, the shared server terminal 1 1 B or the mapping server terminal 12 stores in its 
storage device both HTML and E-VRML files. 

In an HTML file, linking between different files is performed by URL In a VRML or E-VRML file, such attributes as 
WWWAnchor and WWWInline can be specified for objects. WWWAnchor is an attribute for linking a hyper text to an 
30 object, a file of link destination being specified by URL WWWInline is an attribute for describing an external view of a 
building for example in parts of external wall, roof, window, and door for example. An URL can be related to each of the 
parts. Thus, also in VRML or E-VRML files, link can be established with other files by means of WWWAnchor or 
WWWInline. 

For application software (a WWW browser) for notifying a WWW server terminal of a URL entered in a client termi- 
35 nal in the WWW system to interpret and display an HTML file coming from the WWW server terminal, Netscape Navi- 
gator (register trade name) (hereafter referred to simply as Netscape) of Netscape Communications, Inc. is known. For 
example, the client terminal 1 3 also uses Netscape to user the capability for transferring data with the WWW server ter- 
minal. 

It should be noted, however, that this WWW browser can interpret an HTML file and display the same; but this 
t • 40 WWW browser cannot interpret and display a VRML or E-VRML file although it can receive these files. Therefore, a 
VRML browser is required which can interpret a VRML file and an E-VRML file and draw and display them as a three- 
dimensional space. 

Details of VRML are disclosed in the Japanese translation of "VRML: Browsing & Building Cyberspace," Mark 
Pesce, 1995, New Readers Publishing.TSBN 1-56205-498-8, the translation being entitled "Getting to Know VRML: 
45 Building and Browsing Three- Dimensional Cyberspace," translated by Kouichi Matsuda, Terunao Gamaike, Shouichi 
Takeuchi, Yasuaki Honda, Junichi Rekimoto. Masayuki Ishikawa, Takeshi Miyashita and Kazuhiro Hara, published 
March 25, 1996, Prenticehall Publishing, ISBN4-931356-37-0. 

The applicant hereof developed CyberPassage (trademark) as application software that includes this VRML 
browser. 

so CyberPassage is composed of the following three software programs: 

(1) CyberPassage Browser 

This is a VRML browser which is based on VRML 1 .0 and prefetches the capabilities (motion and sound) of VRML 
55 2.0 to support E-VRML that provides moving picture capability. In addition, this provides the multi-user capability which 
can be connected to CyberPassage Bureau. For the script language, TCL/TK is used. 
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(2) CyberPassage Conductor 



This is 
construct a 
with ease. 



^ u • u ^ ™ p vrmi hased on VRML 1 .0. This tool can not only simply 
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(3) CyberPassage Bureau 

This is used for a server terminal system for enabling peop.e to meet each other in a virtual reatty space con- 
structed on a network, connected from the CyberPassage > Browser . jn ^ ^ 
In the client terminals 13-1 and ! 3-2 shown « ^ gJ^KSSJS^u is installed in advance and executed. 

" nd HTn in FIG. 31, CvferPassaoe Browser Wnsfers a vane* o, «,,,-, Netscape as . WWW trows., based 
on NCAPI (Netscape Client Application p W™^™t?™'r3 server terminal 1 12 via the Internet. Net- 

rent VRML 2.0 proposals. , . a samde of this browser is provided in the CD-ROM fur- 

30 browser. 

Operating environment of CyberPassage Browser: 

D,« a ,oRr^Pr is as shown in FIG. 33. The minimum operating environment 
The operating environment of CyberPassage Browser ■ ^"hown .n Browser is used aS a stan- 

must be at least satisfied. However, N^^.^J^^ ^Vrecommended operating environment 

dalone VRML browser. In particular, on us.ng in the multi-user, it is aes.rao.e me 

Installing CyberPassage Browser: 

(2) Click "Unzip" button. And the installation package is decompressed. 

(3) "12 files unzipped successfully" appears. Click "OK" button. 

press "Next" button. 

(8) To read "readme" file here, click "Yes" button _ 

(9) When the installation has been completed, click OK button. 

55 Starting CyberPassage Browser: 

Before slanirio CyoerPassage B™,se, se«n g 
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(1) From "Options" menu of Netscape Navigator, execute "General Preference" and open "Preference" window. 
From the upper tab, select "Helper Applications". 

(2) Check "File type" column for "x-world/x-vrml". If it is found, go to (4) below. 

(3) Click "Create New Type" button. Enter "x-world" in "Mime Type" column and "x-vrml" in "Mime SubType" column. 
s Click "OK" button. Enter "wrl" in "Extensions" column. 

(4) Click "Launch the Application:" button. Enter the path name of CyberPassage Browser in the text column below 
this button. Default is 

"\Program Files\Sqny\CyberPassage\bin\vscp. exe". 

(5) Click "OK" button. ' 

10 

Thus, the setting of Netscape Navigator has been completed. Start CyberPassage Browser as follows: 

(1) In "File..Open File" menu of Netscape, read "readme, htm" of the sample CD-ROM. 

(2) Click the link to the sample world, and CyberPassage is automatically started, loading the sample world from 
75 the CD-ROM. 

Uninstalling CyberPassage Browser: 

Execute "Uninstall" from "CyberPassage Folder" of "Program" of the start menu (or in Windows NT, the Program 
20 Manager), and CyberPassage Browser will be uninstalled automatically. 

Operating CyberPassage Browser: 

CyberPassage Browser may be operated intuitively with the mouse 49b, the keyboard 49a, and the buttons on 
25 screen. 

Moving around in the three-dimensional space: 

In the three-dimensional space provided by VRML, such movements done in real world as forward, backward, 
30 rotate right and rotate left for example can be done. CyberPassage Browser implements such movements through the 
following interface: 

By keyboard: 

35 Each of the arrow keys, not shown, on the keyboard 49a generates the following corresponding movement: 

rotate right; 
<r- rotate left; _ 

T move forward; and 

40 I move backward. 

By mouse: 

Operate the mouse all with its left button. 

45 

(1) Keep the left button of the mouse 49b pressed in the window of CyberPassage and move the mouse: 

to the right for rotate right; 
to the left for rotate left; 
so up for forward; and 

down for backward. 



The velocity of movement depends on the displacement of the mouse. 
(2) With the Ctrl (Control) key, not shown, on the keyboard 49a, kept pressed, click an object on screen to get to 
the front of the clicked object. 

The following precautions are required: 
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If a collision with an object occurs, a collision sound is generated and the frame of the screen blinks in red. If this 
happens, any forward movement is blocked. Moving directions must be changed. 

If the user is lost or cannot see anything in the space, click "Home*' button on the right of screen, and the user can 
return to the home position. 

Jumping eye: 

While navigating through a three-dirpensional space, the user may be lost at occasions, rf this happens, the user 
can jump up to have an overhead view afround. 

(1) Click "Jump" button on the right of screen, and the user enters the jumping eye mode and jumps to a position 
from which the user can look down the world. 

(2) Click "Jump" button again, and the user goes down to the original position. 

(3) Alternatively, click any place in the world, and the user gets down to the clicked position. 

Selecting an object: 

When the mouse cursor is moved around on the screen, the shape of the cursor is transformed into a grabber 
(hand) on an object. In this state, click the left button of the mouse, and the action of the grabbed object can be called. 

Loading a VRML file: 

A VRML file can be loaded as follows: 

25 • In Netscape, click the link to the VRML file: 

From "File. .Open File" menu of CyberPassage. select the file having extension M wrl" on disc. 
In "File.. Open URL" menu of CyberPassage. enter the URL 

Click the object in the virtual space for which "URL" is displayed on the mouse cursor. 

30 Operating toolbar buttons: 

Buttons in the toolbar shown in FIG. 37 for example may be used to execute frequently used functions. 

"Back" * Go back to the world read last. 

35 "Forward" Go to the world after going back to the previous world. 

"Home" Move to the home position. 

"Undo" Return a moved object to the original position (to be described later). 

"Bookmark" Attach a bookmark to the current world or position. 

"Scouter" Enter in the scouter mode (to be described later). 

40 "Jump" Enter in the jump eye mode. 

Scouter mode: 

Each object placed in a virtual world may have a character string as information by using the E-VRML capability. 

45 

(1) Click "Scouter" button on the right of screen, and the user enters the scouter mode. 

(2) When the mouse cursor moves onto an object having an information label, the information label is displayed. 

(3) Click "Scouter" button again, and the user exits the scouter mode. 

so Moving an object around: '~ < ' 

With "Alt" (Alternate) key, not shown, on the keyboard 49a pressed, press the left button of the mouse 49b on a 
desired object, and the user can move that object to a desired position with the mouse. This is like moving a coffee cup 
for example on a desk with the hand in the real world. In the virtual reality, however, objects that can be moved are those 
55 having movable attributes. In the sample world, objects may be moved by Digital HandyCam and the like. It should be 
noted that a moved object may be restored to the position before movement only once by using "Undo" button. 
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Connecting to a multi-user server terminal: 

CyberPassage Browser provides a multi-user capability. The multi-user capability allows the sharing of a same 
VRML virtual space among a plurality of users. Currently, the applicant hereof is operating CyberPassage Bureau in the 
5 Internet on an experimental basis. By loading "Chat Room", the server terminal can be connected to share a same 
VRML virtual space with other users, walking together, turning off a room light, having a chat, and doing other activities 
for example. 

This capability is started as follows: 

/ . 

w (1) Make sure that the user's personal computer is linked to the Internet 

(2) . Load the "Chatroom" of the sample world into CyberPassage Browser. This is done by loading 
ASonyVeadme.htm" from the sample CD-ROM clicking "Chat Room". 

(3) Appearance of "Connected to VS Server in the message window indicates successful connection. 

is Thus, the connection to the server has been completed. Interaction with other users is of the following two types: 

(a) Notifying others of an action: 

This is implemented by clicking any of "Hello", "Smile", "Wao!\ "Wooo!!", "Umm...", "Sad", "Bye" and so on in the 
20 "Action" window (refer to FIG. 39). The actions include rotating the user himself (avatar) right or left 36 degrees, 180 
degrees or 360 degrees: 

(b) Talking with others: 

25 This capability is implemented by opening the "Chat" window (refer to FIG. 39) in "View..Chat" menu and entering 

a message from the keyboard 49a into the bottom input column. 

Multi-user worlds: 

30 The following three multi-user worlds are provided by the sample CD-ROM. It should be noted that a chat can be 
made throughout these three worlds commonly. 

(1) Chat Room 

35 This is a room in which chat is made mainly. Some objects in this room are shared among multiple users. There 
are objects which are made gradually transparent every time the left button of the mouse is pressed, used to turn off 
room lights, and hop up when clicked, by way of example. Also, there are hidden holes and the like. 

(2) Play with a ball!! 

40 

When a ball in the air is clicked, the ball flies toward the user who clicked the ball. This ball is shared by all users 
sharing that space to play catch. 

(3) Share your drawing 

45 

A whiteboard is placed in the virtual space. When it is clicked by the left button, the shared whiteboard is displayed. 
Dragging with the left button draws a shape on the whiteboard, the result being shared by the users sharing the space. 

In addition to CyberPassage Browser, the sample CD-ROM stores CyberPassage Conductor and some sample 
VRML files. CyberPassage Bureau is not stored in this CD-ROM, however. It can be downloaded via the Internet 15A 
so from Home Page URL=http://vs. sony.co.jp/ provided by the company at which the applicant hereof works. The company 
also offers, via the Internet, the multi -user world URL=http://japan. park.org/japan/Sony/3DWorld/Circus/. 

Use of CyberPassage Bureau allows the users using CyberPassage Browser to enter together a world described 
in VRML 1 .0. To provide a three-dimensional virtual reality space for enabling this capability, a file described in VRML 
1.0 must be prepared. Then, CyberPassage Bureau (hereinafter appropriately referred to simply as the bureau) is oper- 
55 ated on an appropriate personal computer. Further, a line telling the personal computer on which Bureau is operating 
is added to the VRML 1.0 file. The resultant VRML file is read into CyberPassage Browser (hereinafter appropriately 
referred to simply as the browser), the browser is connected to the bureau. 

If this connection is successful, the users in the virtual world can see each other and talk each other. Further, writ- 
ing an appropriate script into the file allows each user to express emotions through a use of action panel. 
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CyberPassage Browser provides interface for action description through use of TCL. This interface allows each 
user to provide behaviors to objects in the virtual world and, rf desired, make the resultant objects synchronize between 
browsers. This allows a plurality of users to play a three-dimensional game if means for it are prepared. 

To enjoy a multi-user virtual world, three steps are required; preparation of a VRML file, start of CyberPassage 
5 Bureau, and connection of CyberPassage Browser. 

Preparing a VRML file: 

First, a desired VRML. 1 .0 file must jDe prepared. This file is created by oneself or a so-called freeware is used for 
jo this file. This file presents a multi-user virtual world. 

Starting CyberPassage Bureau: 

The operating environment of CyberPassage Bureau is as follows: 

15 

CPU ... 486SX or higher 
OS ... Window 95 

Memory ... 12M or higher 

20 CyberPassage Bureau can be started only by executing the downloaded file. When this CyberPassage Bureau is 

executed, only a menu bar indicating menus is displayed as shown in FIG. 34. Just after starting, CyberPassage Bureau 
is in stopped state. Selecting "status" by pulling down "View" menu displays the status window that indicates the current 
CyberPassage Bureau state. At the same time, a port number waiting for connection is also shown. 

Immediately after starting, CyberPassage Bureau is set such that it waits for connection at TCP port No. 5126. To 
25 change this port number, pull down "options" menu and select "port". When entry of a new port number is prompted, 
. enter a port number 5000 or higher. If the user does not know which port number to enter, default value (51 26) can be 
used. 

To start CyberPassage Bureau from the stopped state, pull down "run" menu and select "start". The server terminal 
comes to be connected at the specified port. At this moment, the state shown in "status" window becomes "running" as 
30 shown in FIG. 34. 

Thus, after completion of the bureau preparations, when CyberPassage Browser comes to connect to CyberPas- 
sage Bureau, it tells the position of the browser to another browser or transfers information such as conversation and 
behavior. 

The "status" window of CyberPassage Bureau is updated every time connection is made by the user, so that using 
35 this window allows the user to make sure of the users existing in that virtual world. 

Connection of CyberPassage Browser: 

Connection of the CyberPassage Browser requires the following two steps. First, instruct CyberPassage Browser 
40 to which bureau it is to be connected. This is done by writing an "info" node to the VRML file. Second, copy the user's 
avatar file to an appropriate direction so that the user can be seen from the other users. 

Adding to a VRML file: 

45 When writing a line specifying the bureau to be connected to the VRML file, a name of the personal computer on 

which the bureau is operating and the port number must be specified in the following format: 
DEF VsServer Into {string"server name:port number"} 
server terminal name is a machine name as used in the Internet on which the bureau is operating (for example, 
fred.--search.sony.com) or its IP address (for example, 123.231 .1 2.1). The port number is one set in the bureau. 
so Consequently, the above-mentioned format becomes as follows for example: . . 

DEF VsServer Info {string"fred.research.sony.com:5126"} 
^ In the example of FIG. 32, the IP address of the shared server terminal 11-1 is 43.0.35.1 17, so that the above-men- 
tioned format becomes as follows: 

DEF VsServer Info {string"43.0 .35.1 17:51261 
55 This is added below the line shown below of the prepared VRML file: 
VRML V1 .0 ascii 
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Copying an avatar file: 

When CyberPassage Browser gets connected to CyberPassage Bureau, the former notifies the latter of its avatar. 
When a specific avatar meets another, the bureau notifies the other browsers of the meeting information to make the 

5 specific avatar be displayed on the other browsers. For this reason, it is required to copy the VRML file of the specific 
avatar to an appropriate place in advance. 

FIG. 34 shows an example of display for selecting an avatar. In this example, a desired avatar can be selected as 
own avatar from "person. wrl", "boy.wjri" or "girl.wrl". 

When the selected avatar file fe copied to the same directory in which own VRML file is stored, the browser 

io searches the directory for the "{person ,boy, girl}, wrr file as the avatar file when the browser loads the VRML file. 

Thus, to share a specific VRML file, CyberPassage Bureau may only be operated, the VsServer Info node be added 
to the VRML file, and "{person. boy. girljwrl" be copied to the same file in which the VRML file is stored. Then, when the 
VRML file is set up such that the same can be loaded from other users, any user who reads the file through CyberPas- 
sage gets connected to the bureau. 

75 As shown in FIG. 32, it is assumed that the shared server terminal 1 1 B-1 uses an avatar nicknamed Koutarou and 

the client terminal 13-1 uses an avatar nicknamed Minami to walk through one of the multi-user worlds, CIRCUS PARK. 
In doing so, the shared server terminal 11 B-1 selects a male avatar "boy.wrl" as shown in FIG. 34 for example. As 
shown in FIG. 35, when "View" menu is pulled down and "Preferences" is selected, a screen as shown in FIG. 36 is 
displayed. On this screen, the user specifies "Koutarou" as the name (Nick Name) of the avatar selected in FIG. 34. 

20 Likewise, the user of the client terminal 13-1 selects "girl.wrl" as own avatar for example, specifies "Minami" as its 

nickname, and enters CIRCUS PARK. When avatar Koutarou of the shared server terminal 1 1B-1 and avatar Minami 
of the client terminal 13-1 move to positions close enough to each other, avatar Minami is displayed on the display 
device 25 of the shared server terminal 11 B-1 as shown in FIG. 35. Ukewise, avatar Koutarou is displayed on the dis- 
play device 45 of the client terminal 13-1 as shown in FIG. 38 to be described later. 

25 It should be noted that, in FIGS. 32 and 34 through 37, "K" is assigned to the display screen of the display device 

25 that avatar Koutarou sees and "M" is assigned to the display screen of the display device 45 that avatar Minami sees. 

As shown in the figures, each display device displays only the three-dimensional virtual reality space (including the 
image of the other avatar) as viewed from own avatar, and own avatar itself is not displayed. 

Thus, when a plurality of avatars approach each other close enough in a specific space (namely, when own avatar 

30 is displayed on the display device of the other user's display device), a chat can be performed by selecting "Chat" from 
"View" menu shown in FIG. 37 for example. FIG. 37 shows an example of display on the display device 25 of the shared 
server terminal 11 B-1 when avatars Koutarou and Minami are having a chat 

As shown in FIG. 37, the messages entered so far from the keyboards of the terminals concerned are shown in the 
"Chat" window. Characters entered by the user are once displayed in the display area at the bottom of the "Chat" win- 

35 dow; when the Enter key, not shown, of the keyboard 49a is pressed, the entered message (character string) is trans- 
mitted to the other user. For example, when message "Yes, it's my first visit today" has come from avatar Minami (the 
client terminal 13-1) to the shared server terminal 1 1 B-1 , this message is displayed in a balloon above avatar Minami 
in the CyberPassage Bureau window on the display device 25 of the shared server terminal 1 1 B-1 and, at the same 
time, displayed in the "Chat" windows after the past messages. 

40 FIG. 38 shows an example of display on the display device 45 of the client terminal 13-1 when message "Let's go 

see the merry-go-round" has been entered from the shared server terminal 1 1 B-i. In this case, too, the message is dis- 
played in a balloon above avatar Koutarou in the "CIRCUS PARK" window and, at the same time, displayed in the "Chat" 
window after the past messages. 

An example of display of FIG. 39 shows the case in which "Hello" button has been pressed on the client terminal 

45 1 3-1 . At this time, as shown in FIG. 39, an image in which avatar Minami raises its right hand is displayed on the shared 
server terminal 1 1 B-1 and, at the same time, voice message "Hello" is heard from the speaker 27. 

When the user leaves his terminal, his avatar may be put in the sleep state. For example, to put avatar Minami in 
the sleep state, "Active" button, one of the action buttons in the action windows shown in FIG. 38, is clicked on the client 
terminal 13-1 to change the shape of this button to "Sleep" button as shown in FIG. 40. Avatar Minami enters the sleep 

so state. In the sleep state, avatar Minami displayed on the displayed device 25 of the shared server terminal 1 1 B-1 is sit- 
ting on the ground as shown in FIG. 41 . The user of the shared server terminal 1 1 B-1 can know from this state (namely, 
the user avatar Minami has left the client terminal 13-1) that avatar Minami is in the sleep state. When "Sleep" button is 
clicked in the sleep state, the button returns to "Active" button again. 

Thus, the users can enjoy themselves walking through the Circus Park as a three-dimensional virtual reality space. 

55 The present invention is applied to embody the parade, the movement of avatars, and avatar behaviors by the 
action window buttons implemented in the above-mentioned Circus Park. 

The present invention has been described by taking for example the case in which the Internet is used for the net- 
work 1 5 and the WWVV system is used. It will be apparent to those skilled in the art that a global communications net- 
work other than the Internet may be used for the network 15 and a communications system other than the WWW 
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system may be used to achieve the above-mentioned objects of the invention. 

As described above according to the present invention, in the three-dimensional virtual reality sharing method, the 
system the information recording medium, the information recording method, the information transmission medium, 
and the information transmission method, the change sequence of the plurality of sub objects corresponding to the 

s updated content of the state of the update object is stored in each client terminal and the changes sequences on the 
plurality of client terminals are started in synchronization. The above-mentioned novel setup allows the behaviors of an 
object having a complex shape composed of a plurality of sub objects to be shared in the same three-dimens.onal vir- 
tual reality space on the plurality of dierjt terminals, thereby significantly enhancing the display speed of images. 

Further according to the present invention, in the information processing method, the client terminal, the informa- 

io tion recording medium, the information recording method, the information transmission medium, and the information 
transmission method, the change sequence of the plurality of sub objects corresponding to the update content of the 
state of the update object is stored in a client terminal and started in synchronization with the change sequences stored 
in other client terminals. The above-mentioned novel setup implements a client terminal that can share the same three- 
dimensional virtual reality space with other client terminals. 

is Further according to the present invention, in the information processing method, the server terminal, the informa- 
tion recording medium, the information recording method, the information transmission medium, and the information 
transmission method, if a message indicating update of the state of the update object is entered from a specrf.c client 
terminal via the global communication network, this message is transmitted to other client terminals via the global com- 
munication network and. in synchronization with the change sequence of the plurality of sub objects in the specific client 

so terminal the change sequences of the plurality of sub objects in the other client terminals are started. The above-men- 
tioned novel setup allows implements a server terminal that can provide the same three-dimensional virtual reality 
space to the plurality of client terminals. 

While the preferred embodiments of the present invention have been described using specific terms, such descrip- 
tion is for illustrative purposes only, and it is to be understood that changes and variations may be made without depart- 

25 ing from the spirit or scope of the appended claims. 

Claims 

1 . A method fo sharing a three-dimensional virtual reality space comprising the steps of: 



30 



connecting a plurality of client terminals (13-1. 13-2, 13-3) for displaying a three-dimensional virtual reality 
space including an update object constituted by a plurality of sub objects each of which state is subject to 
change to a shared server terminal (1 1 -1 , 1 1 -2) for controlling a state of the update object on each of the plu- 
rality of client terminals via a communication network (15); 
35 registering in each of the plurality of client terminals in advance a change sequence table for defining a rela- 

tionship between a sequence of changing the state of each of the plurality of sub objects according to a change 
to the state of the update object and a message for specifying a type of the change sequence; 
when the state of the update object controlled by the shared server terminal is updated, notifying each of the 
plurality of client terminals of the message corresponding to updated content of the state of the update object 
40 from the shared server terminal; and 

changing on each of the plurality of client terminals (13-1 . 13-2. 1 3-3) the state of each of the plurality of sub 
objects based on the change sequence specified by the message to reflect the change in the displayed three- 
dimensional virtual reality space. 

The method of sharing a three-dimensional virtual reality space according to claim 1 . wherein each of the plurality 
of client terminals (13-1, 13-2. 13-3), if the state of the update object is updated according to an operation per- 
formed by a user of each of the plurality of client terminals, notifies the shared server terminal of the message cor- 
responding to the updated content. 

The method of sharing a three-dimensional virtual reality space according to claim 1 , wherein the updated content 
of the state of the update object is a behavior including displacement and rotation. 

The method of sharing a three-dimensional virtual reality space according to claim 1. wherein the change 
sequence is a procedure of composite cooperative operations of the plurality of sub objects. 

The method of sharing a three-dimensional virtual reality space according to claim 1. wherein the change 
sequence includes at least one of a direction of displacement, a velocity of displacement, a period of displacement 
and a distance is displacement, and a direction of rotation, a velocity of rotation, a period of rotation and a distance 
of rotation, of each of the plurality of sub objects. 
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6. The method of sharing a three-dimensional virtual reality space according to claim 1 , wherein the shared server 
terminal (11-1, 11-2) notifies each of the plurality of client terminals (13-1. 13-2, 13-3) of the message correspond- 
ing to the updated content of the update object in a predetermined timing. 

5 7. The method of sharing a three-dimensional virtual reality space according to claim 1, wherein the communication 
network transfers the message between unspecified the plurality of client terminals and the shared server terminal 
based on a communication protocol called TCP/IP (Transmission Control Protocol/Internet Protocol). 

8. The method of sharing a three-fciimensipnal virtual reality space according to claim 1, wherein three-dimensional 
w graphics data for representing the update object is written in VRML (Virtual Reality Modeling Language). 

9. A system of sharing a three-dimensional virtual reality space comprising: 

a plurality of client terminals (13-1,13-2,1 3-3) for displaying a three-dimensional virtual reality space including 
is an update object constituted by a plurality of sub objects each of which state is subject to change; 

a shared server terminal for controlling a state of the update object on each of the plurality of client terminals; 
a communication network (15) for connecting each of the plurality of client terminals to the shared server ter- 
minal; and 

a change sequence table for defining a relationship between a change sequence of the state of each of the sub 
20 objects corresponding to update content of the state of the update object and a message for specifying a type 

of the change sequence, the change sequence table being registered in each of the plurality of client terminals 
in advance; 

wherein, when the state of the update object controlled by the shared server terminal is updated, the shared 
25 server terminal notifies each of the plurality of client terminals of the message corresponding to updated content of 

the state of the update object, and 

each of the client terminals changes the state of each of the plurality of sub objects based on the change 
sequence specified by the message to reflect the change in the displayed three-dimensional virtual reality space. 

30 10. An information recording medium for use in a three-dimensional virtual reality space sharing system to record a 
computer program comprising the processing steps of: 

connecting a plurality of client terminals (13-3, 13-2, 13-3) for displaying a three-dimensional virtual reality 
space including an update object constituted by a plurality of sub objects each of which state is subject to 
35 change to a shared server terminal for controlling a state of the update object on each of the plurality of client 

terminals via a communication network; 

registering in each of the plurality of client terminals in advance a change sequence table for defining a rela- 
tionship between a sequence of changing the state of each of the plurality of sub objects according to a change 
to the state of the update object and a message for specifying a type of the change sequence; 
40 when the state of the update object controlled by the shared server terminal (11-1. 11-2) is updated, notifying 

each of the plurality of client terminals of the message corresponding to updated content of the state of the 
update object from the shared server terminal; and 

changing on each of the plurality of client terminals the state of each of the plurality of sub objects based on 
the change sequence specified by the message to reflect the change in the displayed three-dimensional virtual 
45 reality space; 

. wherein the computer program is readable and executable by at least one of the terminals consisting of the 
shared server terminal and the plurality of client terminals. 

so 11. An information recording method for use in a three-dimensional virtual reality sharing system to record a computer 
program in an information recording medium, the computer program comprising the processing steps of: 

connecting a plurality of client terminals (13-3. 13-2, 13-3) for displaying a three<iimensional virtual reality 
space including an update object constituted by a plurality of sub objects each of which state is subject to 
55 change to a shared server terminal for controlling a state of the update object on each of the plurality of client 

terminals via a communication network; ^ - 

registering in each of the plurality of client terminals in advance a change sequence table for defining a rela- 
tionship between a sequence of changing the state of each of the plurality of sub objects according to a change' 
to the state of the update object and a message for specifying a type of the change sequence; 
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when the state of the update object controlled by the shared server terminal is updated, notifying each of the 
plurality of client terminals (13-1 , 13-2, 13-3) of the message corresponding to updated content of the state of 
the update object from the shared server terminal; and 

changing on each of the plurality of client terminals the state of each of the plurality of sub objects based on 
the change sequence specified by the message to reflect the change in the displayed three-dimensional virtual 
reality space; 

wherein the computer program is readable and executable by at least one of the terminals consisting of the 
shared server terminal (11-1. 11-2) $nd the plurality of client terminals (13-1. 13-2, 13-3). 

1 2. An information transmission medium for use in a three-dimensional virtual reality space sharing system to transmit 
a computer program comprising the processing steps of: 

connecting a plurality of client terminals (13-1 , 13-2, 13-3) for displaying a three-dimensional virtual reality 
space including an update object constituted by a plurality of sub objects each of which state is subject to 
change to a shared server terminal (11-1,11-2) for controlling a state of the update object on each of the plu- 
rality of client terminals (13-1, 13-2, 13-3) via a communication network (15); 

registering in each of the plurality of client terminals in advance a change sequence table for defining a rela- 
tionship between a sequence of changing the state of each of the plurality of sub objects according to a change 
to the state of the update object and a message for specifying a type of the change sequence; 
when the state of the update object controlled by the shared server terminal is updated, notifying each of the 
plurality of client terminals of the message corresponding to updated content of the state of the update object 
from the shared server terminal; and 

changing on each of the plurality of client terminals the state of each of the plurality of sub objects based on 
the change sequence specified by the message to reflect the change in the displayed three-dimensional virtual 
reality space; 

wherein the computer program is readable and executable by at least one of the terminals consisting of the 
shared server terminal and the plurality of client terminals and the executable computer program is transmitted to 
at least one of the terminals consisting of the shared server terminal and the plurality of client terminals. 

1 3. An information transmission method for use in a three-dimensional virtual reality space sharing system to transmit 
a computer program comprising the processing steps of: 

connecting a plurality of client terminals (13-1, 13-2, 13-3) for displaying a threeKjimensional virtual reality 
space including an update object constituted by a plurality of sub objects each of which state is subject to 
change to a shared server terminal (1 1 -1 , 1 1 -2) for controlling a state of the update object on each of the plu- 
rality of client terminals via a communication network (15); 

registering in each of the plurality of client terminals in advance a change sequence table for defining a rela- 
tionship between a sequence of changing the state of each of the plurality of sub objects according to a change 
to the state of the update object and a message for specifying a type of the change sequence; 
when the state of the update object controlled by the shared server terminal is updated, notifying each of the 
plurality of client terminals of the message corresponding to updated content of the state of the update object 
from the shared server terminal; and 

changing on each of the plurality of client terminals (13-2, 13-2, 13-3) the state of each of the plurality of sub 
objects based on the change sequence specified by the message to reflect the change in the displayed three 
dimensional virtual reality space; 

wherein the computer program is readable and executable by at least one of the terminals consisting of the 
shared server terminal and the plurality of client terminals and the executable computer program is transmitted to 
at least one of the terminals consisting of the shared server terminal (1 1 -1 , 1 1 -2) and the plurality of client -termi- 
nals. 

14. An information processing method of a client terminal in a three-dimensional virtual reality space sharing system 
in which a plurality of client terminals for displaying a three-dimensional virtual reality space including an update 
object constituted by a plurality of sub objects each of which state is subject to change are connected to a shared 
server terminal for controlling a state of the update object on each of the plurality of client terminals via a commu- 
nication network (1 5), the information processing method comprising the steps of : 
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13-2, 13-3) via a communication network (15), the information transmission method transmitting a computer pro- 
gram comprising the processing steps of : 

registering in each of the plurality of client terminals in advance a change sequence table for defining a rela- 
5 ' tionship between a sequence of changing the state of each of the plurality of sub objects according to a change 

to the state of the update object and a message for specifying a type of the change sequence; 
acquiring the message corresponding to the update content of the state of the update object, the message 
being notified from the shared server terminal (11-1, 11-2) when the state of the update object controlled by 
the shared server terminal is undated; and 
10 changing the state of each of the plurality of sub objects based on the change sequence specified by the mes- 

sage to reflect the change in the displayed three-dimensional virtual reality space; 

wherein the computer program is transmitted to the client terminal in a state receivable and executable by 
the same. 

15 

19. An information transmission method for use on a client terminal in a three-dimensional virtual reality space sharing 
system in which plurality of client terminals (13-1 , 1 3-2, 13-3) for displaying a three-dimensional virtual reality space 
including an update object constituted by a plurality of sub objects each of which state is subject to change are con- 
nected to a shared server terminal (1 1-1 , 11-2) for controlling a state of the update object on each of the plurality 
20 of client terminals via a communication network (1 5), the information transmission method transmitting a computer 
program comprising the processing steps of: 

registering in each of the plurality of client terminals in advance a change sequence table for defining a rela- 
tionship between a sequence of changing the state of each of the plurality of sub objects according to a change 
25 to the state of the update object and a message for specifying a type of the change sequence; 

acquiring the message corresponding to the update content of the state of the update object, the message 
being notified from the shared server terminal (11-1. 11 -2) when the state of the update object controlled by 
the shared server terminal is updated; and 

changing the state of each of the plurality of sub objects based on the change sequence specified by the mes- 
30 sage to reflect the change in the displayed three-dimensional virtual reality space; 

wherein the computer program is transmitted to the client terminal in a state receivable and executable by 
the same. 

35 20. An information processing method of a shared server terminal in a three-dimensional virtual reality space sharing 
system in which a plurality of client terminals for displaying a three-dimensional virtual reality space including an 
update object constituted by a plurality of sub objects each of which state is subject to change are connected to a 
shared server terminal for controlling a state of the update object on each of the plurality of client terminals (13- 
1,13-2,13-3) via a communication network (15), the information processing method comprising the steps of: 

40 

determining update of the state of the update object controlled by the shared server terminal; and 
when the state of the update object is updated, notifying each of the plurality of client terminals of a message 
for specifying a type of a change sequence of each of the plurality of sub objects corresponding to updated 
content of the state of the update object from the shared server terminal. 

45 

21 . A shared server terminal in a three-dimensional virtual reality space sharing system in which a plurality of client ter- 
minals (13-1 , 13-2, 13-3) for displaying a three-dimensional virtual reality space including an update object consti- 
tuted by a plurality of sub objects each of which state is subject to change are connected to a shared server 
terminal for controlling a state of the update object on each of the plurality of client terminals via a communication 

so network, the shared server terminal comprising: 

a determining means for determining update of the state of the update object controlled by the shared server 
terminal; and 

when the state of the update object is updated, a notifying means for notifying each of the plurality of client ter- 
55 minals of a message for specifying a type of a change sequence of each of the plurality of sub objects corre- 

sponding to updated content of the state of the update object from the shared server terminal (11-1,11 -2). 

22. An information recording medium for use on a shared server terminal in a three-dimensional virtual reality space 
sharing system in which a plurality of client terminals for displaying a three-dimensional virtual reality space includ- 
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registering in each of the plurality of client terminals in advance a change sequence table for defining a rela- 
tionship between a sequence of changing the state of each of the plurality of sub objects according to a change 
to the state of the update object and a message for specifying a type of the change sequence; 
acquiring the message corresponding to the update content of the state of the update object, the message 
being notified from the shared server terminal (11-1, 11-2) when the state of the update object controlled by 
the shared server terminal is updated; and 

changing the state of each of the plurality of sub objects based on the change sequence specified by the mes- 
sage to reflect the change ir*the displayed, three-dimensional virtual reality space. 

15. A client terminal in a three-dimensional virtual reality space sharing system in which a plurality of client terminals 
for displaying a three-dimensional virtual reality space including an update object constituted by a plurality of sub 
objects each of which state is subject to change are connected to a shared server terminal for controlling a state of 
the update object on each of the plurality of client terminals via a communication network (15), the client terminal 
comprising: 

a registering means for registering in each of the plurality of client terminals in advance a change sequence- 
table for defining a relationship between a sequence of changing the state of each of the plurality of sub objects 
according to a change to the state of the update object and a message for specifying a type of the change 
sequence; - * 

an acquiring means for acquiring the message corresponding to the update content of the state of the update 
object, the message being notified from the shared server terminal when the state of the update object control- 
led by the shared server terminal is updated; and 

a changing means for changing the state of each of the plurality of sub objects based on the change sequence 
specified by the message to reflect the change in the displayed three-dimensional virtual reality space. 

16. An information recording medium for use in a client terminal in a three-dimensional virtual reality space sharing 
, system to record a computer program comprising the processing steps of : 

registering in each of the plurality of client terminals in advance a change sequence table for defining a rela- 
tionship between a sequence of changing the state of each of the plurality of sub objects according to a change 
to the state of the update object and a message for specifying a type of the change sequence; 
acquiring the message corresponding to the update content of the state of the update object, the message 
being notified from the shared server terminal when the state of the update object controlled by the shared 
server terminal is updated; and 

changing the state of each of the plurality of sub objects based on the change sequence specified by the mes- 
sage to reflect the change in the displayed three-dimensional virtual reality space; 

wherein the computer program is recorded in the information recording medium in a state readable and exe- 
cutable by the client terminal. 

17. An information recording method of a recording medium for use on a client terminal in a three-dimensional virtual 
reality space sharing system to record a computer program comprising the processing steps of: 

registering in each of the plurality of client terminals in advance a change sequence table for defining a rela- 
tionship between a sequence of changing the state of each of tine plurality of sub objects according to a change 
to the state of the update object and a message for specifying a type of the change sequence; 
acquiring the message corresponding to the update content of the state of the update object, the message 
being notified from the shared server terminal (11-1,11-2) when the state of the update object controlled by 
the shared server terminal is updated; and 

changing the state of each of the plurality of sub objects based on the change sequence specified by the mes- 
sage to reflect the change in the displayed three-dimensional virtual reality space; 

wherein the computer program is recorded in the recording medium in a state readable and executable by 
the client terminal. 

1 8. An information transmission medium for use on a client terminal in a three-dimensional virtual reality space sharing 
system in which a plurality of client terminals for displaying a three-dimensional virtual reality space including an 
update object constituted by a plurality of sub objects each of which state is subject to change are connected to a 
shared server terminal for controlling a state of the update object on each of the plurality of client terminals (13-1 , 

- " . " \ 
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ing an update object constituted by a plurality of sub objects each of which state is subject to change are connected 
to a shared server terminal for controlling a state of the update object on each of the plurality of client terminals (13- 
1,13-2 13-3) via a communication network (15), the information recording medium recording a computer program 
comprising the processing steps of: 

5 

determining update of the state of the update object controlled by the shared server terminal; and 
when the state of the update object is updated, notifying each of the plurality of client terminals of a message 
for specifying a type of a change sequence of each of the plurality of sub objects corresponding to updated 
content of the state of the update object from the shared server terminal (1 1-1,11-2); 

10 

wherein the computer program is stored in the information recording medium in a state readable and exe- 
cutable by the shared server terminal. 

23. An information recording method for use on a shared server terminal in a three-dimensional virtual reality space 
75 sharing system in which a plurality of client terminals for displaying a three-dimensional virtual reality space includ- 
ing an update object constituted by a plurality of sub objects each of which state is subject to change are connected 
to a shared server terminal for controlling a state of the update object on each of the plurality of client terminals via 
a communication network (15), the information recording method recording a computer program comprising of the 
processing steps of: 

20 

determining update of the state of the update object controlled by the shared server terminal; and 
when the state of the update object is updated, notifying each of the plurality of client terminals (13-1, 13-2, 13- 
3) of a message for specifying a type of a change sequence of each of the plurality of sub objects correspond- 
ing to updated content of the state of the update object from the shared server terminal; 

25 

wherein the computer program is stored in an information recording medium in a state readable and execut- 
able by the shared server terminal (11-1.11-2) 

24. An information transmission medium for use on a shared server terminal in a three<limensionai virtual reality space 
30 sharing system in which a plurality of client terminals for displaying a three-dimensional virtual reality space includ- 
ing an update object constituted by a plurality of sub objects each of which state is subject to change are connected 
to a shared server terminal (11-1,11 -2) for controlling a state of the update object on each of the plurality of client 

- terminals via a communication network (15), the information transmission medium transmitting a computer pro- 
gram comprising the processing steps of: 

35 

determining update of the state of the update object controlled by the shared server terminal; and 
■- when the state of the update object is updated, notifying each of the plurality of client terminals of a message 
for specifying a type of a change sequence of each of the plurality of sub objects corresponding to updated 
content of the state of the update object from the shared server terminal; 

40 

wherein the computer program is transmitted to the shared server terminal in a state receivable and execut- 
able by the same. 

25. An information transmission method for use on a shared server terminal in a three-dimensional virtual reality space 
45 sharing system in which a plurality of client terminals (13-1, 13-2, 13-3) for displaying a three-dimensional virtual 

reality space including an update object constituted by a plurality of sub objects each of which state is subject to 
change are connected to a shared server terminal for controlling a state of the update object on each of the plurality 
of client terminals via a communication network (1 5), the information transmission method transmitting a computer 
program comprising the processing steps of: 

50 

determining update of the state of the update object controlled by the shared server terminal; and 
when the state of the update ofject is updated, notifying each of the plurality of client terminals (13-1 , 13-2, 13- 
3) of a message for specifying a type of a change sequence of each of the plurality of sub objects correspond- 
ing to updated content of the state of the update object from the shared server terminal; 

55 

wherein the computer program is transmitted to the shared server terminal in a state receivable and execut- 
able by the same. 
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